• Support for together.ai inference server
• Support for ollama local inference server
• GPT-4 Vision support
• Added :json and :md_json modes to support more models and inference servers

• Default http settings and where they are stored

before:

config :openai, http_options: [...]

after:

config :instructor, :openai, http_options: [...]

• OpenAI client to allow for better control of default settings and reduce dependencies

• Instructor.Adapters.Llamacpp for running instructor against local llms.
• use Instructor.EctoType for supporting custom ecto types.
• More documentation

• Bug fixes in ecto --> json_schema --> gbnf grammar pipeline, added better tests

• Schemaless Ecto support
• response_model: {:partial, Model} partial streaming mode
• response_model: {:array, Model} record streaming mode

• Bug handling nested module names

• use Instructor.Validator for validation callbacks on your Ecto Schemas
• max_retries: option to reask the LLM to fix any validation errors

• Structured prompting with LLMs using Ecto