• 0 Posts
  • 19 Comments
Joined 3 years ago
cake
Cake day: September 24th, 2023

help-circle








  • Assuming that’s a genuine question…

    AI needs feedback just the same as humans. I would think of AI like a human that’s of average cleverness, but has a huge breadth of knowledge and basically infinite time and patience. They are going to be decent at assembly but they’re still going to make mistakes just like humans.

    Using a language like Rust that has a lot of static correctness checks gives a higher quality result for AI, just like it does for humans.



  • None of those have been successful for various reasons (I think primarily because they all sound like they’d be a total nightmare to set up and maintain).

    As soon as uv provides an alternative implementation so you can just run uv run --but-fast I think it will become popular.

    I would not be at all surprised if they are secretly working on a faster Python implementation. They own all of the non-shit Python tooling, they have unlimited tokens now, they aren’t afraid of vibe coding. Why not?







  • If you didn’t use a profiler, then how can you be sure that the issue was Python and not something else?

    It was a relatively simple program and I am good at programming.

    The point is, I put the same amount of effort into writing the same program in Python and Rust, and Rust was 50x faster. With AI, I don’t see any reason to use Python these days anyway. I never bought the productivity arguments before (Rust is easily as productive as Python), but with AI Rust is definitely more productive than Python because of the much stronger static checks.


  • Did you use a profiler to find the bottlenecks?

    No. It was a simple enough program that there were no areas for improvement anyway. I also did not use a profiler for the Rust code.

    good Python devs know how to find bottlenecks in their software and replace them with fast implementations

    In my experience this is also a sweet sounding lie to make people feel ok with using Python. Yes in some case you make a big mistake and there’s a large bottleneck you can easily remove… Or your program has a nice small hotspot where it spends most of its time and you can just write that bit in C++ (AI is the obvious example).

    But most programs are not like that. They’re more like MS Word. Slowness is evenly distributed through the code. There is no hotspot to remove.

    As an example of this, look at Nicholas Nethercote’s excellent series of blogs on making the Rust compiler faster: https://nnethercote.github.io/

    The “bottlenecks” they find result in 1% speedups.