<div id="readability-page-1" class="page"><div>Mistral AI just announced <a href="https://mistral.ai/news/codestral/" target="_blank" rel="noopener noreferrer" data-external="true">Codestral</a>: a open-weight model designed for code generation tasks. It outperforms other models in a long-range eval for code generation and is fluent in 80+ programming languages. We test capabilities of the new Mistral's model on data analysis tasks, using the <a href="https://github.com/e2b-dev/code-interpreter" target="_blank" rel="noopener noreferrer" data-external="true">Code Interpreter SDK</a> by <a href="https://docs.e2b.dev/" target="_blank" rel="noopener noreferrer" data-external="true">E2B</a>.
Codestral doesn't support using tools for code execution yet, so in this Python example, we added the code interpreting capabilities. We are going to build an AI agent that performs data analysis tasks on provided data, in a form of a csv file.
🔗 <a href="https://github.com/e2b-dev/e2b-cookbook/tree/main/examples/codestral-code-interpreter-python" target="_blank" rel="noopener noreferrer" data-external="true">Full code on GitHub</a>
<h2 id="why-code-interpreter-sdk">Why Code Interpreter SDK</h2>
E2B's code interpreter SDK quickly creates a secure cloud sandbox powered by <a href="https://github.com/firecracker-microvm/firecracker" target="_blank" rel="noopener noreferrer" data-external="true">Firecracker</a>. Inside this sandbox is a running Jupyter server that the LLM can use.
In general, the Code Interpreter SDK allows you to build custom code interpreters. For example, you can install custom packages, have access to the internet, use the filesystem, or connect your cloud storage. The Code Interpreter SDK works with <a href="https://github.com/e2b-dev/e2b-cookbook/tree/main" target="_blank" rel="noopener noreferrer" data-external="true">any LLM</a>. (in this example, we are using it with the Mistral's newest model).
<h3 id="key-links">Key links</h3>

<h3 id="overview">Overview</h3>
<ol>
<li>Installing dependencies</li>
<li>Defining API keys and prompt</li>
<li>Implementation of method for code interpreting</li>
<li>Adding tmethod for calling Codestral and parsing its response</li>
<li>Adding method for data upload</li>
<li>Putting everything together</li>
</ol>
<h2 id="setup">Setup</h2>
<h3 id="1-installing-dependencies">1. Installing dependencies</h3>
We start by install the <a href="https://github.com/e2b-dev/code-interpreter" target="_blank" rel="noopener noreferrer" data-external="true">E2B code interpreter SDK</a> and <a href="https://console.mistral.ai/" target="_blank" rel="noopener noreferrer" data-external="true">Mistral's Python SDK</a>.
<figure><div><pre tabindex="0"><code>%pip install mistralai e2b_code_interpreter</code></pre></div></figure>
<h3 id="2-defining-api-keys-and-prompt">2. Defining API keys and prompt</h3>
Let's define our variables with API keys for Mistral and E2B together with the model ID and prompt. We won't be defining any tools because Codestral doesn't support tool usage yet.
<figure><div><pre tabindex="0"><code># TODO: Get your Mistral API key from https://console.mistral.ai
MISTRAL_API_KEY = ""

# TODO: Get your E2B API key from https://docs.e2b.dev
E2B_API_KEY = ""

MODEL_NAME = "codestral-latest"

SYSTEM_PROMPT = """You're a python data scientist that is analyzing daily temperature of major cities. You are given tasks to complete and you run python code to solve them.

Information about the the temperature dataset:
- It's in the `/home/user/city_temperature.csv` file
- The CSV file is using `,` as the delimiter
- It has following columns (examples included):
 - `Region`: "North America", "Europe"
 - `Country`: "Iceland"
 - `State`: for example "Texas" but can also be null
 - `City`: "Prague"
 - `Month`: "June"
 - `Day`: 1-31
 - `Year`: 2002
 - `AvgTemperature`: temperature in celsiu, for example 24

Generally, you follow these rules:
- ALWAYS FORMAT YOUR RESPONSE IN MARKDOWN
- ALWAYS RESPOND ONLY WITH CODE IN CODE BLOCK LIKE THIS:
```python
{code}
```
- the python code runs in jupyter notebook.
- every time you generate python, the code is executed in a separate cell. it's okay to multiple calls to `execute_python`.
- display visualizations using matplotlib or any other visualization library directly in the notebook. don't worry about saving the visualizations to a file.
- you have access to the internet and can make api requests.
- you also have access to the filesystem and can read/write files.
- you can install any pip package (if it exists) if you need to by running `!pip install {package}`. The usual packages for data analysis are already preinstalled though.
- you can run any python code you want, everything is running in a secure sandbox environment
"""</code></pre></div></figure>
As an equivalent to missing function calling, we instruct the model to return messages in Markdown and then parse and extract the Python code block on our own.
<figure><div><pre tabindex="0"><code>import re
pattern = re.compile(r'```python\n(.*?)\n```', re.DOTALL) # Match everything in between ```python and ```
def match_code_block(llm_response):
 match = pattern.search(llm_response)
 if match:
 code = match.group(1)
 print(code)
 return code
 return ""</code></pre></div></figure>
<h3 id="3-implementation-of-method-for-code-interpreting">3. Implementation of method for code interpreting</h3>
Here's the main function that use the E2B code interpreter SDK. We'll be calling this function a little bit further when we're parsing the Codestral's response with tool calls.
<figure><div><pre tabindex="0"><code>def code_interpret(e2b_code_interpreter, code):
 print("Running code interpreter...")
 exec = e2b_code_interpreter.notebook.exec_cell(
 code,
 on_stderr=lambda stderr: print("[Code Interpreter]", stderr),
 on_stdout=lambda stdout: print("[Code Interpreter]", stdout),
 # You can also stream code execution results
 # on_result=...
 )

 if exec.error:
 print("[Code Interpreter ERROR]", exec.error)
 else:
 return exec.results</code></pre></div></figure>
<h3 id="4-adding-tmethod-for-calling-codestral-and-parsing-its-response">4. Adding tmethod for calling Codestral and parsing its response</h3>
Now we're going to define and implement <code>chat</code> method. In this method, we'll call the Codestral LLM, parse the output to extract any Python code block, and call our <code>code_interpret</code> method we defined above.
<figure><div><pre tabindex="0"><code>from mistralai.client import MistralClient

client = MistralClient(api_key=MISTRAL_API_KEY)

def chat(e2b_code_interpreter, user_message):
 print(f"\n{'='*50}\nUser message: {user_message}\n{'='*50}")

 messages = [
 {"role": "system", "content": SYSTEM_PROMPT},
 {"role": "user", "content": user_message}
 ]

 # Codestral doesn't support tools/function calling yet
 response = client.chat(
 model=MODEL_NAME,
 messages=messages,
 )
 response_message = response.choices[0].message
 python_code = match_code_block(response_message.content)
 if python_code != "":
 code_interpreter_results = code_interpret(e2b_code_interpreter, python_code)
 return code_interpreter_results
 else:
 print(f"Failed to match any Python code in model's response {response_message}")
 return[]</code></pre></div></figure>
<h3 id="5-adding-method-for-data-upload">5. Adding method for data upload</h3>
Now we implement a method to upload our dataset to the code interpreter sandbox. The file gets uploaded to the E2B sandbox where our code interpreter is running. We get the file's remote path in the <code>remote_path</code> variable.
<figure><div><pre tabindex="0"><code>def upload_dataset(code_interpreter):
 print("Uploading dataset to Code Interpreter sandbox...")
 with open("./city_temperature.csv", "rb") as f:
 remote_path = code_interpreter.upload_file(f)
 print("Uploaded at", remote_path)</code></pre></div></figure>
<h3 id="6-putting-everything-together">6. Putting everything together</h3>
In this last step, we put all the pieces together. We instantiate a new code interpreter instance using <code>with CodeInterpreter(api_key=E2B_API_KEY) as code_interpreter:</code> and then call the <code>chat</code> method with our user message and the <code>code_interpreter</code> instance.
<figure><div><pre tabindex="0"><code>from e2b_code_interpreter import CodeInterpreter

with CodeInterpreter(api_key=E2B_API_KEY) as code_interpreter:
 # Upload the dataset to the code interpreter sandbox
 upload_dataset(code_interpreter)

 code_results = chat(
 code_interpreter,
 "Plot average temperature over the years in Algeria"
 )
 if code_results:
 first_result = code_results[0]
 else:
 raise Exception("No code interpreter results")


# This will render the image
# You can also access the data directly
# first_result.png
# first_result.jpg
# first_result.pdf
# ...
first_result</code></pre></div></figure>
‍
This is how the resulting plot generated by the LLM looks like, based on the dataset.
<figure></figure>
🔗 <a href="https://github.com/e2b-dev/e2b-cookbook/tree/main/examples/codestral-code-interpreter-python" target="_blank" rel="noopener noreferrer" data-external="true">Full code on GitHub</a>
<h3 id="key-links-1">Key links</h3>
</div></div>

E2B Blog & Customer Stories

Vaclav Mlejnsky

In this Python step-by-step guide, we give the new Mistal's model code interpreter as a tool.

AI Code Execution with Mistral's Codestral

댓글