model refs thread

i like that @Alex ...could we do something like:

import { genkit } from "genkit";
import { vertexAI } from "@genkit-ai/vertexai";

const llamaInstruct = vertexAI.model('llama3-405b-instruct-mass');

const ai = genkit({
  plugins: [vertexAI(...)],
  studioModels: [llamaInstruct],
})

import { genkit } from "genkit";
import { vertexAI } from "@genkit-ai/vertexai";

const llamaInstruct = vertexAI.model('llama3-405b-instruct-mass');

const ai = genkit({
  plugins: [vertexAI(...)],
  studioModels: [llamaInstruct],
})

import { genkit } from "genkit";
import { vertexAI } from "@genkit-ai/vertexai";

const llamaInstruct = vertexAI.model('llama3-405b-instruct-mass');

const ai = genkit({
  plugins: [vertexAI(...)],
  studioModels: [llamaInstruct],
})

import { genkit } from "genkit";
import { vertexAI } from "@genkit-ai/vertexai";

const llamaInstruct = vertexAI.model('llama3-405b-instruct-mass');

const ai = genkit({
  plugins: [vertexAI(...)],
  studioModels: [llamaInstruct],
})

where basically if providers have extra models that aren't available "out of the box" you can just pass their refs in (i like this better than plugin-specific fields). could work for e.g. finetunes as well

model refs thread

Similar Threads

Similar Threads

Similar Threads