Step 3.7 Flash - 198B Open Source Model That Does Everything; Does it Really?

Added: 2026-05-31

[00:00:01]You're about to see some dancing steps from Step 3.7 Flash, a brand new mixture of expert model from StepFun. I have given it this prompt to go through my Python project and understand what each file does and then create a report through Hermes agent. This is Fahad Mirza and I welcome you to the channel.

[00:00:25]The model which we are discussing is this freshly out of oven Step 3.7 Flash from StepFun 198 billion parameter model open weight multimodal and available right now. We are various platforms. You can also get it installed locally, but you would need to sell a kidney and multiple GPUs in order to get it working locally.

[00:00:49]If you want to know how to do that still, you can just go to my channel and just search with StepFun as we have installed many models from them locally, but for the purpose of this video, I'm just going to save my kidney and do it through API because I don't have a multi-GPU cluster. But if you're looking for one, you can simply go to the video's description and get Mastered Computes uh link and a discount coupon code. Follow me on X for any AI updates.

[00:01:21]Okay, so marketing is done. Let me now quickly tell you all about this model.

[00:01:26]And by the way, this already has finished, but we will get to it shortly because I think now you know what we are going to unpack in this video. This is again a sparse mixture of expert model. As I said, only 11 billion activate per tokens. The context window is huge, 256K, which is quite good. It is able to handle images and videos natively and we are going to test it out shortly.

[00:01:53]Also, the good thing is that it gives you three reasoning levels and it is also available in contest format, but still even for contest you would at least need two GPUs or three GPUs to run it decently.

[00:02:08]The reasoning levels are low, medium, and high, which is quite common these days, but the best thing is that the model is Apache 2 license, which is always a good idea. VLLM SG Lang both supported. We will also talk about these benchmarks without boring you to death with numbers. Uh but for now, let's go back to our Hermes agent and see what exactly the model has done here.

[00:02:33]And now, let's review the output. I'm just going to scroll down in Hermes agent, and you can see that the model has scanned five Python files, understood the full architecture of a cert monitoring app, which is my app, and wrote a detailed structured report, which I will show you shortly, all in one shot.

[00:02:53]Another cool thing which I can identify right off the bat is that it also used parallel file reads, terminal command, and a diff review tried without any hand-holding. This is a diff.

[00:03:06]Pretty good.

[00:03:08]This is impressive.

[00:03:10]But I think there were a couple of hiccups. One is that it was hitting max output token mid-response, which is not good.

[00:03:17]You know, I already had given it a lot of tokens, by the way.

[00:03:22]Anyway, you see, it has omitted it, but then it has given us the format of the report.

[00:03:29]Um but it recovered, which is good.

[00:03:31]Let's see what sort of report it has generated.

[00:03:36]And this is a markdown file. Let me open it in the VS Code.

[00:03:40]So, if you look at this report, this is perfect, I guess. You see?

[00:03:44]This is quite good. It has really gone deep and wide in order to obtain what I have given it.

[00:03:51]All the key symbols, all the files are there.

[00:03:54]It has given me the synopsis of the code.

[00:03:57]I'm taking my sweet time just to make sure that we do it properly and be fair with the model. I think it has done well.

[00:04:05]It has done pretty well and this is all open source by the way.

[00:04:09]Well done. So, Hermit agent plus this, I think this is a good coding companion.

[00:04:17]And now let's do a multi-linguality test. For that, I'm going to give it this a very very fine sentence that whatever you can do or dream you can begin it. Boldness has genius, power and magic in it.

[00:04:32]You need to So, the model needs to translate it into all of these world languages and if you can tell me in the comments who has said this without looking up in any of the search engine or AI, full marks to you.

[00:04:46]Okay, so let me now run this and we will check out the translation. Please also help me out. What do you think about it in your own native language? And if your language is not included into this list, let me know, please and I will include it in the next video.

[00:05:04]And this is the result and to be honest, model has handled all 80 plus languages including obscure ones like Gutnish, Faroese and Tigrinya without breaking a sweat. I'm just going to scroll through.

[00:05:17]I have checked few and I think it has done quite well. Some of them are slightly little but overall, it's a solid result.

[00:05:25]And it has even gone with some of the scripts and RTL like Arabic, Urdu, Burmese and few others all rendered correctly.

[00:05:34]And I'm just scrolling down. You can pause and check your language.

[00:05:40]And these are 80 plus languages as I said from all across the globe.

[00:05:45]Some of them are regional but most of them are quite good. I have just included this beautiful Balochi language from Pakistan.

[00:05:54]And I think I also included Basque language. I guess this is a um thing just on the border of Spain and France.

[00:06:03]So, let me know what do you think about it. Even it went up with this gibberish translation. So, pretty good.

[00:06:13]Okay, so now let's try out couple more things.

[00:06:18]Now, in the next test, what I'm going to do is to check multimodality, but with a twist. I'm going to show the model this image of a lightning storm.

[00:06:27]And in the Hermeze agent, I'm asking the model to look at this image, and I will also give it the path shortly.

[00:06:35]And then I'm asking it to uh I have described it that it shows a lightning strike over this create an index.html file on the basis of it, and then I just build that index.html file, which we we will actually run it in the browser. So, let me give it the path of the image.

[00:06:54]Now, I have given it the path, so I will just run it. While it runs and does its magic, let's talk about uh maybe the benchmarks very quickly.

[00:07:04]So, you can see that on Agentic benchmarks, it has already topped Claude Eval, which tests how well a model holds its instructions across long multi-turn sessions, which we also tested it around cross-file checking. In our first prompt, it has beaten both Gemini 2.5 Pro and GPT-4, which are quite old. That is the only drawback here. Anyway, on multimodal, it leads simple VQA search, but on terminal bench and GDP Eval, it trails behind GPT-5 and Claude Opus 4.7.

[00:07:37]And on uh humanities last exam or HLE with tools, it also sits behind both of these as well. Sweet bench bro puts it in second place for agentic coding. So, I think strong on agentic reliability and multi-modality plus multi-linguality, but not yet at the top for raw coding and terminal tasks. But, we will see.

[00:08:00]And it has created the code. It is giving me all the information around it.

[00:08:05]I'm also showing you the raw stuffs just as a matter of transparency. So, this is all the synopsis of the code, and it has saved it here on this location. I haven't really looked at it yet. This is index.html file.

[00:08:22]Let's check it out together. I'm just going to drag and drop.

[00:08:26]And already it looks good. Instruction following is awesome. It has changed the colors, but I'm still waiting for the lightning.

[00:08:33]Do you see any lightning? I don't see any lightning.

[00:08:37]I don't see any lightning. I do see some terrain is there.

[00:08:42]All that stuff is there. You know, some uh sort of pressure vibes are coming these concentric circles, but there is nothing there. I think this test this has failed, and I think this really matches with uh with saw around raw coding. Doesn't really do that well.

[00:09:01]But, at least it was able to see that image and then understand it and tried its best. Anyway, I cannot test video with it because uh this API doesn't support it, and I think I already have exhausted all my credits there.

[00:09:15]Um bit expensive, too, by the way. I think I already have spent around $10 or so just for these tests.

[00:09:21]Anyway, let me know what do you think about this model.

[00:09:25]And if you want me to make a local video, please become a member of the channel so that I could just fund some multi-cluster GPU, and then we will have another fun round. That's it. Thank you for all the support.