PLI

Portkey • LLMs in Prod

This is a space where industry practitioners deploying LLMs in production can share insights and learn from one another.

Join

PLI

Portkey • LLMs in Prod

This is a space where industry practitioners deploying LLMs in production can share insights and learn from one another.

Join

feature-releases

bulletin

Vrushank | Portkey

6/12/2025

Hi everyone, there is an [ongoing GCP outage](https://news.ycombinator.com/item?id=44260810)

Hi everyone, there is an ongoing GCP outage This is affecting Portkey UI (app.portkey.ai) right now, and you may be noticing the following issues: - Logged out of the Portkey control plane automatically - Logging in throws an error...

Vrushank | Portkey

2/6/2025

@everyone, @rohit [did a podcast](https://www.youtube.com/watch?v=-rSbvS0qLqY) with @swyx.io on **Wh

@everyone, @rohit did a podcast with @swyx.io on Why every AI Engineer needs an AI Gateway This podcast touched upon many many interesting aspects around AI Gateways, Guardrails, LLM Observability, and more. If you're curious about where Portkey is headed, or want to learn in depth about how various companies use Portkey right now, you should definitely watch this podcast this weekend!...

Vrushank | Portkey

1/3/2025

Organizing a small meetup in Bangalore next week on Multi-agentic systems & MCP: https://lu.ma/b8he8

Organizing a small meetup in Bangalore next week on Multi-agentic systems & MCP: https://lu.ma/b8he8td0

Vrushank | Portkey

1/1/2025

vim 2024.txt

vim 2024.txt - respawn on github - open source core of portkey - get to 6,700 stars...

Vrushank | Portkey

12/20/2024

Starting this week's AI Eng Hours now: https://discord.gg/J2mnVkWddu?event=1317202150492733440

Starting this week's AI Eng Hours now: https://discord.gg/J2mnVkWddu?event=1317202150492733440 We're discussing: - The latest updates to OpenAI & Anthropic, like the o1 models, PDF support, etc - Portkey's latest MCP Client launch...

Vrushank | Portkey

11/28/2024

Hey everyone! 👋

Hey everyone! 👋 We're launching something exciting: Weekly AI Engineering Hours, starting tomorrow! Why? Portkey is growing fast (have you seen our new prompt versioning with custom labels? 🎯), and we want to make sure you're getting the most out of every feature....

Vrushank | Portkey

11/28/2024

Are you going to AWS re:Invent next week? Team Portkey is hosting an informal catch up for Portkey c

Are you going to AWS re:Invent next week? Team Portkey is hosting an informal catch up for Portkey community members with @rohit & @ayush-portkey! Join in: https://lu.ma/jyreb3gd...

Vrushank | Portkey

8/5/2024

We are talking with the folks at Aporia about bringing AI Guardrails on top of Portkey's open source

We are talking with the folks at Aporia about bringing AI Guardrails on top of Portkey's open source Gateway. Join us! https://discord.gg/portkey-llms-in-prod-1143393887742861333?event=1270019838307467265...

Vrushank | Portkey

7/29/2024

The LLMs in Prod community event was a huge success! AI engineers, leaders, researchers, and more ca

The LLMs in Prod community event was a huge success! AI engineers, leaders, researchers, and more came together to discuss the best practices of putting AI in production. We discussed, - The AI Gateway pattern, around which we're building #gateway-oss - Scaling DSPy for production...

Vrushank | Portkey

6/19/2024

We are putting together the first **LLMs in Prod** event in Bengaluru next week.

We are putting together the first LLMs in Prod event in Bengaluru next week. Register here - https://lu.ma/84ozf8xx...

Vrushank | Portkey

6/1/2024

Team Portkey is going to be at the [AI Mayhem](https://lu.ma/ai-mayhem) hackathon in Bangalore!

Team Portkey is going to be at the AI Mayhem hackathon in Bangalore! Please DM me if you'd like to join!...

Vrushank | Portkey

5/18/2024

@ayush-portkey is doing an AMA at [r/developersIndia](https://www.reddit.com/r/developersIndia/comme

@ayush-portkey is doing an AMA at r/developersIndia to talk all about Startups, Engineering, Leadership, and Gen AI. Link to AMA → Here...

Vrushank | Portkey

5/14/2024

We crossed **1,000** members here on Discord yesterday.

We crossed 1,000 members here on Discord yesterday. Of the 1,000+ about 60% are @🏗️ Practitioner
Really excited to initiate deeper conversations, bring world-class guests, and tackle the challenges of LLMs in production, together....

Vrushank | Portkey

5/13/2024

@everyone Join the OpenAI Spring Watch Party!

@everyone Join the OpenAI Spring Watch Party! https://discord.gg/bVY5cfGZ?event=1239617551743451137...

Vrushank | Portkey

4/12/2024

@everyone Portkey Community goes to New York! 🗽

@everyone Portkey Community goes to New York! 🗽 We are bringing together world-class practitioners & leaders who have successfully built and scaled LLM-based apps to production, in the heart of New York this 24th April. Featuring our own @rohit, Yoni from Noetica, Sarmad from LastMileAI, Chris from Nvidia. and Aaron from Gunderson Legal, moderated by Chip from Flybridge....

Vrushank | Portkey

3/6/2024

@🏗️ Practitioner Excited to host a Workshop on Multimodal LLMs this Friday!

@🏗️ Practitioner Excited to host a Workshop on Multimodal LLMs this Friday! Hear from @dragon (Div Garg, Founder, MultiOn) and @Chinmay (EM, Quizizz) on how they are putting vision models in production — their learnings, challenges, and the way forward! Mark Interested here to get notified when we go live: https://discord.gg/Vad7FEV9tn?event=1214842127100551238...

Vrushank | Portkey

2/9/2024

The chat with **Rohit Chatter** on **Semantic Caching at Walmart** is now published!

The chat with Rohit Chatter on Semantic Caching at Walmart is now published! → You can listen to the recording here...

Vrushank | Portkey

2/1/2024

@everyone Our [LLMs in Prod event](https://lu.ma/llms-in-production) with Llamaindex, Databricks, Li

@everyone Our LLMs in Prod event with Llamaindex, Databricks, Lightspeed, and Postman is now being livestreamed! Join the stream here. Say a Hi on #prod-discussions if you're attending in-person! 👋...

Vrushank | Portkey

1/16/2024

We've got people joining in! The Semantic Cache event starting in 2-3 mins!

Vrushank | Portkey

1/4/2024

**@🏗️ Practitioner, gear up for a high-impact technical talk!**

@🏗️ Practitioner, gear up for a high-impact technical talk! We've invited Rohit Chatter (Chief Architect, Walmart Tech) to the community for a fireside chat on everything vector DBs & semantic caching. 📅 Date: Next Tue, 16 Jan, 12 PM IST...

Gaming

Programming

Portkey • LLMs in Prod

This is a space where industry practitioners deploying LLMs in production can share insights and learn from one another.

Portkey • LLMs in Prod

This is a space where industry practitioners deploying LLMs in production can share insights and learn from one another.