<div id="readability-page-1" class="page"><div><p>This is a view by the E2B team, so the thoughts and comments are based on our experience with the AI space.&nbsp;<a href="https://e2b.dev/" target="_blank" rel="noopener noreferrer" data-external="true">E2B</a> provides sandboxed cloud environments for AI-powered apps and agentic workflows.</p>
<p>Check out our <a href="https://docs.e2b.dev/?ref=october-newsletter" target="_blank" rel="noopener noreferrer" data-external="true">sandbox runtime for LLMs</a><a href="https://github.com/e2b-dev" target="_blank" rel="noopener noreferrer" data-external="true">.</a><a href="https://github.com/e2b-dev" target="_blank" rel="noopener noreferrer" data-external="true">‍</a></p>
<p><a href="https://github.com/e2b-dev" target="_blank" rel="noopener noreferrer" data-external="true">We are open-source</a>, so please check out our <a href="https://github.com/e2b-dev/e2b" target="_blank" rel="noopener noreferrer" data-external="true">GitHub</a>, and support us with a star. ✴️</p>
<p>The highly anticipated OpenAI DevDay is likely to be remembered as the biggest AI event in 2023.</p>
<p>For weeks, rumors have been circulating, predicting that the way we use ChatGPT is about to change completely, and the announcements will kill many AI startups. After watching the <a href="https://www.youtube.com/watch?v=U9mJuUkhUzk" target="_blank" rel="noopener noreferrer" data-external="true">DevDay Opening Keynote</a> together with our community, we are discussing the <a href="https://openai.com/blog/new-models-and-developer-products-announced-at-devday" target="_blank" rel="noopener noreferrer" data-external="true">major announcements</a>.</p>
<h2 id="the-announcements">The announcements</h2>
<p>Sam Altman shared on the stage three major updates:</p>
<ol>
<li><strong>GPT-4 Turbo launch</strong> - with longer context, more control, better knowledge, new modalities, customization, and higher rate limits</li>
<li><strong>GPTs</strong> - Customized versions of ChatGPT</li>
<li><strong>Assistants API</strong> - a playground for building AI assistants (the GPTs)</li>
</ol>
<p>These are the three big news in detail:</p>
<h3 id="1-gpt-4-turbo">1. GPT-4 Turbo</h3>
<p>When we talked to medium/enterprise companies this year, many of them have AI projects just waiting for a lower price and better latency to launch. The new GPT-4 Turbo model is addressing this, among other things.</p>
<p>Starting now, it is much cheaper than GPT-4, in particular:</p>
<ul>
<li>3 times less for input tokens.</li>
<li>2 times less for output tokens.</li>
</ul>
<figure><figcaption>Source (https://openai.com/blog/new-models-and-developer-products-announced-at-devday)</figcaption></figure>
<p>This is indeed great news for developers of AI agents and apps.</p>
<figure></figure>
<p>The six major updates in GPT 4 Turbo are:</p>
<h4 id="01-context-length">01. Context length</h4>
<p>While GPT-4 supports up to 8k (in some cases up to 32k) context length, GPT-4 Turbo offers 128k context length. That is approximately 300 pages of a standard book, so it could remember what happened to Tolkien’s <a href="https://www.amazon.com/Hobbit-J-R-Tolkien/dp/054792822X" target="_blank" rel="noopener noreferrer" data-external="true">hobbits</a> throughout the book.</p>
<p>Sam mentioned that Turbo also is <strong>more accurate</strong>.</p>
<h4 id="02-more-control">02. More control</h4>
<p>Reliability has been a huge problem for AI developers, given the unpredictable outputs of LLM models.</p>
<p>Addressing feedback from developers, there will be more control over the model's responses and outputs. This could partly compensate for the LLMs' stochasticity.</p>
<p>First, OpenAI announces a “JSON load” feature which ensures that the model will respond with valid JSON. That will make the API calls much easier.</p>
<figure><figcaption>Developers have struggled with invalid JSON output in the past. Source (https://community.openai.com/search?q=invalid%20json)</figcaption></figure>
<p>Second, the GPT-4 Turbo is significantly better at function calling. You can now call many functions at once.</p>
<figure><figcaption>Source (https://x.com/IanSoh23/status/1721598405930082522?s=20)</figcaption></figure>
<p>The model will do better at following instructions in general.</p>
<p>Finally, Altman announced a beta of <a href="https://platform.openai.com/docs/guides/text-generation" target="_blank" rel="noopener noreferrer" data-external="true">reproducible outputs</a> as a new feature. That allows to pass the seed parameter to the model, which will make it return consistent outputs. That provides the user a higher degree of control over model behavior.</p>
<h4 id="03-updated-knowledge">03. Updated knowledge</h4>
<p>The knowledge cutoff has been extended to April 2023 and will continue to see improvements.</p>
<p>Additionally, OpenAI is surfing on the current hype, adding built-in RAG. RAG <a href="https://www.ai.engineer/summit/" target="_blank" rel="noopener noreferrer" data-external="true">sparked a lot of interest</a> among developers and became a major topic at conferences. OpenAI is now introducing a retrieval feature in its platform. This allows users to incorporate information from external documents or databases into their projects.</p>
<h4 id="04-new-modalities">04. New modalities</h4>
<p>Surprising no one, DALL·E 3, GPT-4 Turbo with Vision, and the new text-to-speech (TTS) model are all going to into the OpenAI API now.</p>
<p>Developers can <a href="https://platform.openai.com/docs/guides/images" target="_blank" rel="noopener noreferrer" data-external="true">integrate DALL·E 3</a> to ChatGPT Plus and Enterprise users, directly into their apps and products through our Images API by specifying dall-e-3 as the model.</p>
<figure></figure>
<h4 id="05-customization">05. Customization</h4>
<p>Fine-tuning has proven to be highly effective for GPT-3.5 since its launch a few months ago. Starting immediately, OpenAI is extending this approach to the 16k version of the model.</p>
<p>OpenAI is inviting active fine-tuning users to <a href="https://openai.com/form/custom-models" target="_blank" rel="noopener noreferrer" data-external="true">apply</a> for an experimental GPT-4 fine-tuning <a href="https://openai.com/form/custom-models" target="_blank" rel="noopener noreferrer" data-external="true">Custom Models program</a>.</p>
<p>It should allow close collaboration between the researchers and companies to create highly customized models for specific use cases. This includes modifying all aspects of the model training process, including domain-specific pre-training and post-training tailored to a particular domain.</p>
<h4 id="06-higher-rate-limits">06. Higher rate limits</h4>
<p>OpenAI is doubling tokens per minute for GPT-4 customers and allowing rate limit changes in API settings.</p>
<p>They're introducing Copyright Shield to cover legal costs for copyright claims in ChatGPT Enterprise and the API, emphasizing they don't train models using API or ChatGPT Enterprise data.</p>
<p>“And let me be clear,” adds Sam Altman. “This is a good time to remind people, that we do not train on data from the API or ChatGPT Enterprise ever.”</p>
<figure></figure>
<h3 id="2-gpts-customized-versions-of-chatgpt">2. GPTs - Customized versions of ChatGPT</h3>
<p>The OpenAI DevDay was the (first ever) conference for developers. However, the launch with the biggest hype, GPTs, is consumer-facing.</p>
<p>You may recall that OpenAI indicated in February that it intended to allow users to <a href="https://synthedia.substack.com/p/openai-to-offer-chatgpt-customization" target="_blank" rel="noopener noreferrer" data-external="true">define their own customizable AI agents</a>. The rumors prior to the DevDay were true - here come the OpenAI customizable GPTs.</p>
<p>You can now create custom versions of ChatGPT <strong>without knowing how to code</strong>. GPTs combine instructions, extra knowledge, and any combination of skills.</p>
<p>Example GPTs available for ChatGPT Plus and Enterprise users, with more users to follow.</p>
<figure><figcaption>Source (https://openai.com/blog/introducing-gpts)</figcaption></figure>
<p>OpenAI decided to include the AI community that is shaping the future, proven for example by the fact that “<a href="https://www.similarweb.com/blog/insights/ai-news/character-ai-engagement/" target="_blank" rel="noopener noreferrer" data-external="true">ChatGPT Is More Famous, but Character.AI Wins on Engagement</a>”. (Users of Character.AI - a chatbot interface where you can customize your chat avatars - allegedly spend an average of two hours per day on the site.)</p>
<figure><figcaption>Source (https://x.com/mlejva/status/1721593994952532312?s=20)</figcaption></figure>
<p>GPT Store will be launched soon, featuring creations by verified builders.</p>
<h4 id="why-gpts">Why “GPTs”?</h4>
<p>OpenAI avoided the term “AI agent” and used "<a href="https://openai.com/blog/introducing-gpts" target="_blank" rel="noopener noreferrer" data-external="true">GPTs</a>", even though they follow the characteristics of agents.</p>
<p>It may be due to better connecting “GPT” with already publicly accepted “ChatGPT”. “GPTs” may be more relatable to the broader public. The emphasis is put on using natural language to program.</p>
<p>Recall the definition of <a href="https://lilianweng.github.io/posts/2023-06-23-agent/" target="_blank" rel="noopener noreferrer" data-external="true">LLM Powered Autonomous Agents</a> by Lilian Weng from OpenAI where agents were specified by</p>
<ul>
<li>Long-term memory</li>
<li>Planning</li>
<li>Tool use.</li>
</ul>
<p>I see some parallels with GPTs, which have:</p>
<ul>
<li>Expanded Knowledge</li>
<li>Custom Instructions</li>
<li>Actions.</li>
</ul>
<figure><figcaption>OpenAI is communicating its new product as "GPTs" while still referring to it as "agents". Source (https://x.com/miramurati/status/1721668069796593958?s=20)</figcaption></figure>
<h3 id="3-assistants-api">3. Assistants API</h3>
<p>The <a href="https://platform.openai.com/docs/assistants/overview" target="_blank" rel="noopener noreferrer" data-external="true">assistants API</a> is basically a <strong>developer-facing part of the GPTs</strong>. It works as self-coding API-level agents.</p>
<p>It simplifies the process for developers to create their own AI-powered assistants with well-defined objectives and the ability to call models and tools. You <strong>no longer need to include all previous messages</strong> for context when sending a new one to the API.</p>
<p>OpenAI also shipped a new <a href="https://platform.openai.com/playground?mode=assistant" target="_blank" rel="noopener noreferrer" data-external="true"><strong>playground</strong></a> to build the assistants. What is interesting to me is how OpenAI just targets both no-code "developers" and traditional developers with the Assistants API. I was expecting something more d</p>
<p>The Assistants API includes:</p>
<ul>
<li>Better function calling</li>
<li>Built-in conversation management</li>
<li>Python sandbox</li>
<li>Memory</li>
</ul>
<p>It offers using two tools so far:</p>
<ul>
<li>Retrieval</li>
<li>Code interpreter (Which was called "Advanced Data Analyst" until recently).</li>
</ul>
<p>We can probably expect more tools to be added soon, and there is already an option to add your custom tool. <strong>The tools are essentially just OpenAI Functions</strong>.</p>
<figure></figure>
<p><a href="/resources/e2b-sandbox"><strong>How is the OpenAI Code Interpreter different from E2B Sandboxes</strong></a>?</p>
<h3 id="what-are-the-implications">What are the implications?</h3>
<p>OpenAI is shifting from focusing solely on AGI to prioritizing the commoditization of software development and building a platform. This will have a huge impact on coding and prototyping.</p>
<p>Companies react quickly to the updates. Langchain, the most popular framework for building AI agents, quickly announced OpenGPTs as an alternative to OpenAI’s GPTs.</p>
<figure><figcaption>Source (https://github.com/langchain-ai/opengpts)</figcaption></figure>
<p>The announcements certainly put many companies in danger, e.g. vector database startups jeopardized by the Assistants API's retrieval.</p>
<p>Hopefully, most startups and companies won't go out of business. Instead, we'll see even more AI companies building and adding completely new AI features to their products.</p>
<p>For the AI developer community, 2024 will certainly be the production year, and we are excited to see what’s coming.</p>
<figure></figure>
<h3 id="about-openai-devday">About OpenAI DevDay</h3>
<p>OpenAI’s <a href="https://openai.com/blog/announcing-openai-devday" target="_blank" rel="noopener noreferrer" data-external="true">first developer conference</a> took place in San Francisco, CA, on November 6, 202.</p>
<p>The goal was to bring hundreds of developers from around the world together with the team at OpenAI to preview new tools and exchange ideas</p>
<figure><figcaption>Source (https://openai.com/devday/)</figcaption></figure></div></div>

E2B Blog & Customer Stories

Vaclav Mlejnsky

Summarizing the announcements from one of the biggest AI events in 2023.

OpenAI DevDay

댓글