We're all training similarly large base++; near same data, just pricing it differently... with grok removing a few filters and maybe some safeguards? For that matter, many of the benchmarks are flawed and are just easily gamed and whatnot. iykyk.
Very cool and what an amazing way to learn so much beyond what you do in those years at university (at least in the engineering sense). I wish we had software and hardware open to be able to run custom setups whether its NVIDIA on x64 or Ampere/arm64 with MacOS.
Considering Musk's power and the shrinking moat of OpenAI you would think he would be create something better with government support - or as some new department.
It seemed to be some capacity issue with the CDNs. When I stopped and restarted the stream it worked again. Perhaps they do not use real time multi-cdn switching.
I know the California CC system pretty well and have taken a few courses. In tech, there are usually two main paths: either transferring to a 4-year school for CS/Engineering, or specializing in something like Cybersecurity, AWS, Cisco, etc. For Software Engineering, there’s not gonna be any employer demand for those students at CCs since most people going that route tend to transfer to a university and their education/experience isn't really complete for that role.
Intel was getting something like $20 billion from the CHIPS act - but it seems like by the time the fabs would have been ready TSMC will already have them beat to 1.4nm/a14 (also using High NA EUV). Intel has just consistently failed to execute whereas TSMC has been fairly close to schedule.