🌽 Friday - AI Wrap-up #13

AuthorAuthor

Martin Musiol & Daniel Aguspina
July 19, 2024 • Estimated Reading Time: 7 minutes

The things [AI cases] that are too expensive or fragile to use right now will become cheaper and less fragile … and more complicated use cases will become possible.
The story will be: we scaled up!

Kevin Scott, Microsoft CTO.

👋 Hey there, Martin here.

Just in! OpenAI has introduced GPT-4o mini - the most cost-efficient model so far.

Further this week, Mistral AI has two new models: for math and code (with a fundamentally different architecture—called Mamba!).

Microsoft’s CTO thinks scaling models will continue, the EU AI Act dropped milestones and dates ☝️, and more.

Reading time is approx. 125 sec; vamos!

own

Mistral AI releases two new research models - for math and code

  1. Mathstral (Source):

    • 7B-parameter model with 32k token context window

    • Achieves significantly better results than comparable math-focused model

    • You can deploy and fine-tune it. See here.

  2. Codestral Mamba (Source):

    • Mamba is a new AI architecture:

      • Main advantages of a Mamba compared to transformers):

        • It can quickly handle long texts or data (because of its linear time complexity).

        • It can remember important information for a long time (because it has a state space memory).

        • Paper for deep-dive.

      • I mentioned it already: it might be the next AI architecture of choice - the successor of transformers.

    • 7B-parameter model

    • On the context length Mistral AI says: “We have tested Codestral Mamba on in-context retrieval capabilities up to 256k tokens. We expect it to be a great local code assistant!“

      • This will drive a lot of value. The model is small enough to run it on your laptop, and can handle books and books of context. Important for evaluating your code!

    • It can currently not outperform Codestral, the transformer version with 20B parameter.

Did you know?

You can download these AI models (their weights) and integrate them into your applications in minutes.

Coding image

Learn how to build virtually anything with my upcoming course.

How? With my upcoming email/ online course.

It is launching in the next 3 weeks.

I am intensely coding and building professional, full-fledged web applications, connecting AI models to them.

With AI, anyone can build web apps, mobile apps, professional company projects, and much more.

And some things are not possible yet.

Would you like to join my email course on building your project with AI?

Login or Subscribe to participate in polls.

JUST OUT! Introducing GPT-4o mini!

It’s OpenAI’s most intelligent and affordable small model available today in the API. GPT-4o mini is significantly more intelligent and cheaper than GPT-3.5 Turbo.

From OpenAI.com

The benchmarks.

Pro tip: Introducing GPT-4o mini to an application running with OpenAI API GPT-4o can reduce costs by 30x in 99% of cases.

Reply to the email in case you would like to have a conversation about that.

https://x.com/OpenAIDevs/status/1813990748406317221

Pricing trend on model inference.

Microsoft CTO Kevin Scott thinks LLM “scaling laws” will hold despite criticism

I think so, too; however, that is not all. More is needed to understand the world, not just bigger models. Here are my thoughts on the topic.

The increase in model size and computing power will 100X the capabilities of current AI models

On July 25th, I will speak/ train live about GenAI, AI Agents, and what is next for Artificial General Intelligence (AGI)

[This is not my email/ online course on how to build your projects with AI]

(My title on the banner is not entirely up to date anymore.)

Hopefully, you join.

Hopefully, you join.

🙄 OpenAI’s leaked roadmap to AGI

Last Tuesday's deep dive was on OpenAI's formalization of the stages leading to AGI. Read it here.

OpenAI 5-level AGI Leak

🚨 EU AI Act Published the Key Dates and Milestones

  • August 1, 2024: AI Act enters into force. 📅

  • February 2025: General provisions and prohibitions on certain AI systems apply. ⚖️

  • August 2025: Provisions on notifying authorities, general-purpose AI models, governance, confidentiality, and penalties apply. 🏛️

  • August 2026: The full AI Act applies, with some exceptions. ✅

  • August 2027: Complete enforcement of Article 6(1) and corresponding obligations. 🔒

You can read all about the EU AI Act and its developments here.

own

It’s a wrap.

By the way, these are the messages that make my week!

Source: https://www.linkedin.com/posts/martinmusiol1_i-love-reading-these-messages-activity-7219258800942284800-50ky

Have a great week!

-Martin