>>16996236 I've written my Master's thesis on NLP and was quite interested in the topic, then one year later ChatGPT became a thing and has made me into an absolute cynic about anything AI related
>>16996319 That outside of academia GenAI is used for the lamest fucking shit. On a technical level it's so fascinating how a bigass equation predicting some words can have what feels like a real conversation with you. But to me it's kinda overshadowed by the fact in the process it's ruing the internet, creative fields and society as whole.
>>16996267 Not numbers, space. A lot of NLP methods are just dimensionality reduction techniques from linear algebra. Also LLMs are all about word embeddings.
>>16996332 AI as it's currently known is a shadow ghost of a thought and should not be relied upon for accuracy, veracity, or synthesis. Memory tech could 40x in density yesterday and they could shove 10s trillions parameters in a model and the entirety of all written and spoken thought into the dataset and the systems will still be this way. Because its just a prediction model. Intelligence is not a prediction model. We don't predict that the sequence of words should be equivalent to Bayes' theorem. We know the preceding information is (taken as) true and synthesize new information which tests to also be true.
LLMs will never be able to do this. Yeah the maths and development is cool and all but I instantly degrade anyone who praises these things down to a worm.
>>16996409 "We know the preceding information is true and synthesize new information which tests to also be true".
What you just described is pretty close to statistics, which is centrally about testable information. You should read the book "A Brief History of Intelligence". A defining trait of humans and highly intelligent beings is that they actually simulate/predict the world rather than experience it directly. That is why humans are capable of hallucinations and all sorts of crazy shit.
All vertebrate animals rely on prediction just to move. Giraffes start life on shaky legs because they have to develop a model of how their body will react to inputs. Its all statistical pattern matching, always was.
>>16996413 let me guess the universe is a simulation there's just no end with people like you I'm not predicting where my phone just went on the table, I deliberately moved it there. learning =/= learned