Will JEPA be the next revolutionary technology after GPT?
In an interview with Jacob Effron, Yann LeCun talked about why the LLM as they are now aren’t the path to (general) intelligence and how the JEPA architecture will help. Judge yourself — but before, here are some sources to understand what IS JEPA: Comment by u/johny_james from discussion in learnmachinelearning Basically, an "encoding" is just the model's internal compressed understanding of something — the gist, not the pixels. Think of how you remember a movie: not every frame, but "hero fights villain on a rooftop." That summary is an encoding. Let’s look at a concrete example. Show an AI a photo of a dog with the right half covered, and ask it to fill in what’s missing: ...