Did ChatGPT Just Kill Zapier?

OpenAI has released significant updates, including the ability to use apps directly within ChatGPT and a new tool called Agent Kit for building AI agents. The app integration allows users to seamlessly interact with services like Spotify, Canva, and Figma for tasks such as playlist creation, image generation, and organizational chart design, without leaving the ChatGPT interface. This enhancement offers a more intuitive and powerful experience compared to previous plugin functionalities.

Agent Kit provides a visual canvas for creating multi-agent workflows, allowing developers to build and embed AI agents into their own applications and websites. This tool leverages model context protocols, enabling integration with various external apps and services. While currently focused on OpenAI's models, it lays the groundwork for complex automations and a future ecosystem of interconnected AI agents.

The introduction of these features marks a substantial leap in AI accessibility and functionality, potentially disrupting numerous businesses by empowering users and developers with advanced tools for creation and automation directly within a familiar chat interface.

• Seamless App Integration in ChatGPT: Users can now directly interact with various applications like Spotify, Canva, and Figma within ChatGPT to perform tasks such as creating playlists, generating flyers, and designing organizational charts.
• Agent Kit for Multi-Agent Workflows: A new tool allows for the creation of visual workflows connecting multiple AI agents, which can be embedded into external applications and websites.
• Extensibility through MCP: Agent Kit utilizes Model Context Protocols (MCP) to facilitate integration with a wide range of external services and products that implement these protocols.
• Disruption of Workflow Tools: The introduction of Agent Kit is seen as a potential disruption to existing workflow automation and AI agent building platforms, though it currently relies solely on OpenAI's models.
• Enhanced AI Capabilities: The overall updates aim to make AI more accessible, powerful, and integrated into daily tasks, potentially leading to significant business and creative process transformations.

Related Video Summary

• OpenAI just made your entire tech stack obsolete...
• How To Use OpenAI Agent Builder For Beginners
• OpenAI Agent Builder vs n8n: I Tested Both... Here's What Nobody's Telling You
• AI Safety Expert WARNS: “What's Coming CAN'T Be Stopped"

Apps Inside ChatGPT [1:20]

• Users can now call upon and utilize apps directly within ChatGPT.
• To use an app, one can use the "@" symbol followed by the app's name, for example, "@Spotify."
• The system automatically identifies and adds the app as a tool.
• A demonstration involved creating a Spotify playlist of music similar to "Bloop 182" by prompting ChatGPT.
• This required connecting to the Spotify account and agreeing to terms.
• The result was a playlist titled "Rock Songs Like Blink182" with similar music.
• Pre-built apps include Booking.com, Canva, Corsera, Expedia, Figma, Spotify, and Zillow.
• Upcoming apps include All Trails, Door Dash, Khan Academy, Instacart, Pelaton, Open Table, Target, The Fork, Trip Adviser, Thumbtac, and Uber.
• A Software Development Kit (SDK) is available to help developers create apps for ChatGPT.
• This is considered a more powerful and integrated version of previous plugin functionalities that were less successful.
• The new system lowers the barrier for using these tools, as users simply talk to the desired tool.
• A demonstration of Figma involved creating an organizational chart for a fictional AI company.
• Initially, ChatGPT described the org chart, then suggested using Figma.
• Upon connecting the Figma account, ChatGPT generated the org chart directly in Figma.
• Users can view, scroll, and zoom within the generated chart without leaving ChatGPT.
• Changes can be made to the generated content directly within ChatGPT.
• Adding another layer of employees to the org chart resulted in a Fig Jam diagram update.
• A demonstration using Canva involved creating a flyer for a rock band named "Norc."
• The prompt included concert details: Halloween at North Park Observatory in San Diego, 8:00 p.m., with a guitar player and spooky Halloween elements.
• ChatGPT generated four flyer variations within about a minute.
• These flyers showcased the requested elements, including the band name and concert details.
• This feature transforms ChatGPT into a "team member" that can handle tasks like design and content creation.
• Users can request modifications to generated content by simply asking for tweaks.
• The platform will likely introduce monetization for app developers whose integrations are widely used.
• This approach is seen as more likely to succeed than previous attempts like the custom GPT store.
• The ease of use and potential for ChatGPT to recommend relevant tools will drive adoption.
• The integration is reportedly rolled out for everyone, with no apparent country or plan restrictions.

This to me seems like a much much better, more powerful, more integrated version of what the plugins was that they announced a couple years ago that never really caught on, but I think that was because you had to go and make extra connections to these plugins and it was kind of a pain in the butt. Now you just talk to the tool you want to use and it will just try to access that tool. much lower barrier for anybody to actually use these tools.

To me, this is really fascinating because it almost turns chat GPT into like what feels like a team member that you can just pass stuff over to take care of for you. If you need something done in Figma or something done in Canva, you could basically treat it like a team member and say, "Hey, go make this for me real quick." And it will do it. And then if you need tweaks to the thing that it made, you just tell your team member, "Hey, now change this." and it will go and do it.

AI Video Generation [7:07]

• An experiment aimed to recreate a Starbucks-level advertisement for under $100 using a single AI tool.
• The tool used was Nvidia's new AI video generation platform, designed for marketers with limited budgets.
• The prompt requested a 25-second Starbucks ad for a "Strato Frappuccino."
• Reference images were uploaded to guide the visuals.
• The "ultra quality" setting was selected for a professional look.
• After generating the video, playback speed was adjusted to 1.2x via an edit command.
• The ad regenerated with the requested changes within minutes.
• The finished ad was created for under $100 without leaving the user's room.
• The "ultra quality" option is highlighted as a key differentiator for this AI video generation tool.

So, if you're thinking about making high-quality ads without the huge budget, I definitely recommend checking out Nvidia's generative plan. The ultra quality option is what really sets it apart from other AI video generation tools.

Agent Kit [8:53]

• Agent Kit is a new tool for building AI agents and multi-agent workflows.
• It is described as disruptive to many companies, similar to tools like NAD, Mind Studio, Lindy, Make.com, and Zapier.
• Agent Kit provides a visual canvas for creating and envisioning multi-agent workflows.
• It includes "ChatKit," which allows embedding agents within apps and websites.
• The tool leverages Model Context Protocols (MCP), enabling other apps to create MCP servers and integrate with agent workflows.
• Unlike some existing tools that integrate with many platforms and models, Agent Kit currently focuses on OpenAI's models.
• Agent Kit is accessible through the developer playground at platform.openai.com/agentbuilder.
• Available templates include data enrichment, planning helper, customer service bot, structured data Q&A, document comparison, and internal knowledge assistant, or users can build from scratch.
• The interface features a node-based workflow builder, similar to other agent builders.
• A key distinction is that Agent Kit exclusively uses OpenAI models, whereas other platforms allow integration with various AI models.
• The "start node" can have input variables.
• An agent's instructions can be customized; for example, "You're a helpful assistant."
• Users can select OpenAI models, adjust reasoning, grant tool access, and change verbosity.
• Previewing a basic agent without further development might function like standard ChatGPT.
• Current input triggers are limited to input variables or feeding variables behind the scenes.
• A "file search" node can query uploaded documents (PDFs, doc files) for answers.
• "Guardrails" can be implemented to define what users can and cannot do with the bot, such as preventing the sharing of personally identifiable information (PII) or specific data like credit card numbers.
• Guardrails can also detect potential hallucinations and jailbreaks before responses are sent.
• Connecting to MCP servers allows for integration with a vast array of tools and products that have implemented MCP.
• Built-in MCP connections include HubSpot, Shopify, Gmail, and Google Calendar.
• Users can add custom MCP server details to connect to other services.
• "If else statements" allow for branching workflows based on user input. For example, if a user asks a question, it can go to one agent; if it's a statement, it can go to another.
• The system can branch to specific agents for different types of queries, like answering questions or providing general replies.
• Agent Kit is still in its early stages, with expectations of more node development and tool integrations.
• The platform is evolving rapidly, with many companies expected to develop MCPs to connect with tools like Agent Kit.
• The potential for building complex automations that chain multiple tools and actions (e.g., Slack messages, notifications, emails) is high.
• It's predicted that natural language will be integrated for building agents, allowing users to create workflows via text prompts.
• Examples shown during DevDay included a real-time chatbot for an event agenda app and a travel agent that branches to different agents for flight info or itinerary details, with visual customization (background coloring).

It It's pretty wild. And you can see it's this like visual workflow builder. If you've used tools like NAN or Mind Studio, you'll probably recognize a very similar kind of workflow here.

But man, this is getting really, really, really close to that. And as this builds out, I don't know, some of those companies are going to have to figure out how do we stand out among chat GPT who can just potentially build our features into their product.

I imagine if I had to guess, this is a prediction, but if I had to guess, they're going to allow you to build these with natural language pretty soon, too. Build me an agent that does X and it will go and build out the node-based workflow based on the text prompt that you gave it.