AI is Changing Scientists Understanding of Language Learning and Raising Questions About An Innate Grammar

This template, for example, might contain a “super-rule” that dictates how new pieces are added to existing phrases. Children then only need to learn whether their native language is one, like English, where the verb goes before the object (as in “I eat sushi”), or one like Japanese, where the verb goes after the object (in Japanese, the same sentence is structured as “I sushi eat”).

But new insights into language learning are coming from an unlikely source: artificial intelligence. A new breed of large AI language models can write newspaper articles, poetry and computer code and answer questions truthfully after being exposed to vast amounts of language input. And even more astonishingly, they all do it without the help of grammar.

Even if their choice of words is sometimes strange, nonsensical or contains racist, sexist and other harmful biases, one thing is very clear: the overwhelming majority of the output of these AI language models is grammatically correct. And yet, there are no grammar templates or rules hardwired into them – they rely on linguistic experience alone, messy as it may be.

GPT-3, arguably the most well-known of these models, is a gigantic deep-learning neural network with 175 billion parameters. It was trained to predict the next word in a sentence given what came before across hundreds of billions of words from the internet, books and Wikipedia. When it made a wrong prediction, its parameters were adjusted using an automatic learning algorithm.

Remarkably, GPT-3 can generate believable text reacting to prompts such as “A summary of the last ‘Fast and Furious’ movie is…” or “Write a poem in the style of Emily Dickinson.” Moreover, GPT-3 can respond to SAT level analogies, reading comprehension questions and even solve simple arithmetic problems – all from learning how to predict the next word.

Comparing AI models and human brains

The similarity with human language doesn’t stop here, however. Research published in Nature Neuroscience demonstrated that these artificial deep-learning networks seem to use the same computational principles as the human brain. The research group, led by neuroscientist Uri Hasson, first compared how well GPT-2 – a “little brother” of GPT-3 – and humans could predict the next word in a story taken from the podcast “This American Life”: people and the AI predicted the exact same word nearly 50% of the time.

The researchers recorded volunteers’ brain activity while listening to the story. The best explanation for the patterns of activation they observed was that people’s brains – like GPT-2 – were not just using the preceding one or two words when making predictions but relied on the accumulated context of up to 100 previous words. Altogether, the authors conclude: “Our finding of spontaneous predictive neural signals as participants listen to natural speech suggests that active prediction may underlie humans’ lifelong language learning.”

A possible concern is that these new AI language models are fed a lot of input: GPT-3 was trained on linguistic experience equivalent to 20,000 human years. But a preliminary study that has not yet been peer-reviewed found that GPT-2 can still model human next-word predictions and brain activations even when trained on just 100 million words. That’s well within the amount of linguistic input that an average child might hear during the first 10 years of life.

We are not suggesting that GPT-3 or GPT-2 learn language exactly like children do. Indeed, these AI models do not appear to comprehend much, if anything, of what they are saying, whereas understanding is fundamental to human language use. Still, what these models prove is that a learner – albeit a silicon one – can learn language well enough from mere exposure to produce perfectly good grammatical sentences and do so in a way that resembles human brain processing.

Rethinking language learning

For years, many linguists have believed that learning language is impossible without a built-in grammar template. The new AI models prove otherwise. They demonstrate that the ability to produce grammatical language can be learned from linguistic experience alone. Likewise, we suggest that children do not need an innate grammar to learn language.

“Children should be seen, not heard” goes the old saying, but the latest AI language models suggest that nothing could be further from the truth. Instead, children need to be engaged in the back-and-forth of conversation as much as possible to help them develop their language skills. Linguistic experience – not grammar – is key to becoming a competent language user.

By: &

Source: AI is changing scientists’ understanding of language learning – and raising questions about an innate grammar

.

Critics by Supriya Mangalpalli

Deep Neural Networks have become very significant in everyday real-world applications such as automated face recognition systems and self-driving cars. Deep Neural Network is used by researchers to model the processing of information and examine how this processing is equivalent to that of humans. While how DNNs perform computations can be very different from the human brain.

Hence, researchers have invented a unique approach to understanding whether the human brain and its DNN models recognize things in the same way, using similar steps of computations. Prof Philippe Schyns, Dean of Research Technology at the University of Glasgow, said: “Having a better understanding of whether the human brain and its DNN models recognize things the same way would allow for more accurate real-world applications using DNNs.

This article defines a new approach to better this understanding of how the process works: first, researchers must show that both the brain and the DNNs recognize the same things – such as a face – using the same face features; and, secondly, that the brain and the DNN must process these features in the same way, with the same steps of computations. This research would overcome the main hurdle in AI development i.e. understanding the process of machine learning, which matches how humans process information.

“Creating human-like AI is about more than mimicking human behavior – technology must also be able to process information, or ‘think’, like or better than humans if it is to be fully relied upon. We want to make sure AI models are using the same process to recognize things as a human would, so we don’t just have the illusion that the system is working.”

This research would provide us with more accurate and reliable AI technology that will process information similar to the human brain…

Related contents:

Wednesday’s Child: Olive is an expressive teen who wants to study neuroscience FOX 11 Los Angeles

How Westpac’s ‘Life is eventful’ Effie winning campaign used neuroscience AdNews

00:39 Thu, 20 Oct
19:16 Wed, 19 Oct
17:03 Tue, 18 Oct
16:36 Tue, 18 Oct
14:48 Tue, 18 Oct
14:43 Tue, 18 Oct
13:36 Tue, 18 Oct
01:42 Fri, 14 Oct
17:10 Thu, 13 Oct
18:46 Wed, 12 Oct
18:29 Wed, 12 Oct
Building a bridge between neuroscience and immunology Massachusetts Institute of Technology
07:35 Wed, 12 Oct
17:51 Tue, 11 Oct
14:50 Tue, 11 Oct
20:16 Mon, 10 Oct
20:08 Mon, 10 Oct
01:01 Sat, 08 Oct
14:44 Fri, 07 Oct
00:02 Thu, 06 Oct
11:32 Wed, 05 Oct
22:38 Tue, 04 Oct
17:30 Tue, 04 Oct
16:26 Tue, 04 Oct
09:16 Tue, 04 Oct
17:38 Mon, 03 Oct
15:30 Mon, 03 Oct
14:39 Mon, 03 Oct
00:59 Mon, 03 Oct

.

Marketing Program Apps To Buy:

.

10 Bold Actions In Positive Life     https://jvz3.com/c/202927/383942/
3D Pal Toons     https://jvz6.com/c/202927/381689/
4brandcommercial        https://jvz1.com/c/202927/375487
7 Minutes Kit      https://jvz8.com/c/202927/374505/
9 figure Success        https://jvz8.com/c/202927/384653/
Ad Raven      https://jvz4.com/c/202927/382796/
Ada leadz     https://jvz8.com/c/202927/376381
ADA Web      https://jvz3.com/c/202927/383751/
AdRaven       https://jvz3.com/c/202927/382851/
Adsense Machine      https://jvz2.com/c/202927/290487
Adtivate Agency      https://jvz3.com/c/202927/383706/
AdvertSuite     https://jvz1.com/c/202927/335011/
AdzHero     https://jvz2.com/c/202927/366972/
AffiliateMatic     https://jvz3.com/c/202927/381148/
Agency Client Finder    https://jvz3.com/c/202927/384619/
Agencyscale      https://jvz1.com/c/202927/383113/
AgencyScale      https://jvz4.com/c/202927/383111/
AIWA Commercial     https://jvz2.com/c/202927/365061
ALL-in-One HD Stock    https://jvz4.com/c/202927/381560
Animaxime    https://jvz2.com/c/202927/383307/
Appimize      https://jvz8.com/c/202927/370227
Appoint B Agency     https://jvz1.com/c/202927/384630/
Appointomatic      https://jvz6.com/c/202927/374258
Appowls    https://jvz4.com/c/202927/381231/
Art Of Living    https://jvz4.com/c/202927/382425/
Audiencetoolkit     https://jvz6.com/c/202927/302715
Audika    https://jvz1.com/c/202927/383635/
Aweber Crash Course     https://jvz6.com/c/202927/383057/
Backlinkindexer    https://jvz6.com/c/202927/88118
BettingMaster      https://jvz2.com/c/202927/387079/
BevTraders    http://www.bevtraders.com/?ref=arminham
Big Audio Club     https://jvz6.com/c/202927/380087/
BigAudio Club    https://jvz2.com/c/202927/380877/
Boost Optimism   https://jvz2.com/c/202927/380692/
BrandElevate   https://jvz4.com/c/202927/381807/
BrandElevate   https://jvzoo.com/c/202927/381812
Bybit     https://www.bybit.com/en-US/invite?ref=ALEXP
CanvaKitz    https://jvz4.com/c/202927/379051/
ChatterPal    https://jvz8.com/c/202927/324615
Clientfinda   https://jvz8.com/c/202927/370806
Clipsreel   https://jvz3.com/c/202927/372682
Commission smasher   https://jvz3.com/c/202927/376879
Content Gorilla   https://jvz2.com/c/202927/330783
Content Tool Kit   https://jvz3.com/c/202927/329145/
CourseAlly eLearning   https://jvz4.com/c/202927/384759/
CourseReel   https://jvz2.com/c/202927/355249
Courserious   https://jvz8.com/c/202927/360397/
Coursova   https://jvz1.com/c/202927/376527
Creaitecontent  https://jvz1.com/c/202927/376986
Credit Repair   https://jvz8.com/c/202927/377815/
Cryptokit    https://jvz8.com/c/202927/383809/
CryptoRocket    https://jvz6.com/c/202927/378113/
CryptoUnderworld     https://jvz8.com/c/202927/374345/
Dealcheck     https://dealcheck.io?fp_ref=armin16
DesignaSuite      https://jvz2.com/c/202927/297271
DesignBeast    https://jvz6.com/c/202927/371547
DevelopSelfEmpowerment     https://jvz6.com/c/202927/383094/
DFYContentClub     https://jvz6.com/c/202927/381337/
DFYSuite   https://jvz3.com/c/202927/381194/
Diabetes Guide    https://jvz2.com/c/202927/358870/
Diddly Pay’s    https://jvz2.com/c/202927/315596
Diet fitness diabetes   https://jvz1.com/c/202927/286851
Domainname    https://jvz6.com/c/202927/377005
Dominate Email   https://jvz4.com/c/202927/386980/
Dropshiply   https://jvz3.com/c/202927/383483/
DUX Forex Signals   https://jvz3.com/c/202927/128215/
EBook Agency    https://jvz2.com/c/202927/384573/
Ejaculation Total   https://jvz2.com/c/202927/75989/
Email Monetizer    https://jvz2.com/c/202927/386337/
EngagerMate  https://jvz8.com/c/202927/328172
EngageYard   https://jvz2.com/c/202927/383051/
Explaindio    https://jvz1.com/c/202927/123757/
Extreme Adz   https://jvz8.com/c/202927/379244/
Extreme Coupon  https://jvz1.com/c/202927/216101/
EZ Local Appointment  https://jvz2.com/c/202927/385180/
Ezy  https://jvz1.com/c/202927/381935/
Ezy MultiStores  https://jvzoo.com/c/202927/381935
Facebook Cash Machine   https://jvz4.com/c/202927/382333/
Facedrip  https://jvz1.com/c/202927/376325/
FaceSwap   https://jvz4.com/c/202927/381768/
Fade To Black   https://jvz2.com/c/202927/344541
Fanpage  https://jvz4.com/c/202927/144349
Fitness Nutrition   https://jvz4.com/c/202927/353334/
Followup Builder   https://jvz3.com/c/202927/386313/
Forex Atlatian   https://jvz8.com/c/202927/25069/
Forex Blizz   https://jvz8.com/c/202927/144577/
Forex Blue Stark  https://jvz3.com/c/202927/47481/
Forex expert   https://jvz1.com/c/202927/376877
Forex Hybrid Scalper    https://jvz6.com/c/202927/95037/
Forex Joustar   https://jvz6.com/c/202927/381617/
Forex Mastery   https://jvz2.com/c/202927/144621/
Forex Scouts   https://jvz6.com/c/202927/132677/
forrk  https://jvz1.com/c/202927/373449
FusionMT4    https://jvz2.com/c/202927/372523/
FX Goldminer  https://jvz1.com/c/202927/381439/
Galactic  https://jvz1.com/c/202927/188236/
Gaming job   https://jvz2.com/c/202927/184902  s
Genesis Mining   https://www.genesis-mining.com/a/2535466
Gluten free   https://jvz4.com/c/202927/296191
GMB Magic  https://jvz2.com/c/202927/377194
Graphic Alta  https://jvz2.com/c/202927/324492/
Heal Your Emptiness   https://jvz6.com/c/202927/384848/
High Converting Emails  https://jvz3.com/c/202927/386305/
HostLegends    https://jvz4.com/c/202927/384755/
Hostley Domain Creator   https://jvz1.com/c/202927/379223/
Human Synthesys Studio  https://jvz8.com/c/202927/367353/
ImageX   https://jvz6.com/c/202927/363237/
IMSyndicator  https://jvz1.com/c/202927/370769
Inboxr   https://jvz2.com/c/202927/312692
Insta Keyword    https://jvz6.com/c/202927/351606/
Instant Website   https://jvz2.com/c/202927/377557
InstantWebsiteBundle          https://jvz6.com/c/202927/377557
iTraffic X  https://jvz2.com/c/202927/320466
keysearch  https://jvz3.com/c/202927/194909
KlickCourse   https://jvz3.com/c/202927/385006/
Klippyo Kreators  https://jvz8.com/c/202927/327447
KoinCart   https://jvz2.com/c/202927/383555/
Leadvalet   https://jvz3.com/c/202927/385580/
Levidio Royal Podcasting   https://jvz6.com/c/202927/384025/
Linkable DFY   https://jvz6.com/c/202927/385873/
Linkomatic  https://jvz2.com/c/202927/380937/
LiteTrading   https://www.litefinance.com/?uid=929237543
Live Your Truth  https://jvz6.com/c/202927/379020
Living An Intentional Life    https://jvzoo.com/c/202927/382455
Living an International Life    https://jvz8.com/c/202927/382455/
Local Leader   https://jvz4.com/c/202927/383751/
Local Sites   https://jvz4.com/c/202927/380543/
LocalAgencyBox  https://jvz2.com/c/202927/359468
LocalCentric   https://jvz2.com/c/202927/379339/
LocalioAI    https://jvz6.com/c/202927/378310/
MarketAll      https://jvz2.com/c/202927/386971/
Marketingblocks     https://jvz6.com/c/202927/374934
MarketPresso   https://jvz2.com/c/202927/369837
Mat1 Simple Funnel   https://jvz2.com/c/202927/380197/
Maxslides  https://jvz8.com/c/202927/376842
Mech Forex Robot   https://jvz6.com/c/202927/383447/
MediaCloudPro   https://jvz2.com/c/202927/343635
Megasuite   https://jvz3.com/c/202927/383953/
Mobi First   https://jvz2.com/c/202927/353694/
Motion Kingdom Studio  https://jvz4.com/c/202927/383177/
Movid Animation  https://jvz6.com/c/202927/380385/
MT4Code System   https://jvz2.com/c/202927/376925
My Passive Income   https://jvz1.com/c/202927/384099/
MyMailIt   https://jvz3.com/c/202927/292919
MyTrafficJacker   https://jvz2.com/c/202927/353558
Next Drive  https://jvz4.com/c/202927/371095/
NichBox  https://jvz2.com/c/202927/370705/
Organic Life Guide  https://jvz8.com/c/202927/366872/
Phemex  https://phemex.com/register-vt1?referralCode=D8HUS2
Photokit  https://jvz4.com/c/202927/373207/
PicsAds   https://jvz2.com/c/202927/385468/
PigMoneyMethod   https://jvz2.com/c/202927/377665/
PipStock   http://pipstockexchange.com/register?ref=204
Pitchdeck   https://jvz3.com/c/202927/347847/
Pixal  https://jvz2.com/c/202927/378775/
PixaStudio    https://jvz1.com/c/202927/373089/
Pixivid   https://jvz6.com/c/202927/385213/
PlanB Muscle Growth   https://jvz1.com/c/202927/36517/
PlayerNeos   https://jvz2.com/c/202927/376962
Podcast Advantage   https://jvz8.com/c/202927/379995/
Podcast Masterclass  https://jvz3.com/c/202927/379998/
PodKastr    https://jvz1.com/c/202927/369500/
Poplinks Funnel    https://jvz1.com/c/202927/368095/
Postradamus     https://jvz6.com/c/202927/108695
Power Reviews    https://jvz8.com/c/202927/384625/
Powrsuite   https://jvz1.com/c/202927/376361
PR Rage  https://jvz4.com/c/202927/343405
prime stocks   https://jvz8.com/c/202927/369164  prime stocks
Profile mate    https://jvz4.com/c/202927/358049
Promovidz   https://jvz8.com/c/202927/375692/
Push Button Traffic   https://jvz2.com/c/202927/301402
QR Verse   https://jvz3.com/c/202927/383865/
Quintex Capital     https://quintexcapital.com/?ref=arminham
Quit Smoking    https://jvz3.com/c/202927/359081/
QuizMatic   https://jvz6.com/c/202927/387116/
Reputor   https://jvz8.com/c/202927/380159/
ReVideo  https://jvzoo.com/c/202927/381761
ReviewReel   https://jvz6.com/c/202927/382663/
Rewriter   https://jvz4.com/c/202927/353373/
RSI SEO   https://jvz6.com/c/202927/384381/
Scriptdio   https://jvz4.com/c/202927/385387/
Seniors Income    https://jvz2.com/c/202927/383888/
Senuke  https://jvz6.com/c/202927/279944
ShopABot   https://jvz2.com/c/202927/291955
ShopFunnels   https://jvz3.com/c/202927/384069/
SocialAgency360   https://jvz1.com/c/202927/385357/
SociCake  https://jvz2.com/c/202927/321987
Socifeed   https://jvz6.com/c/202927/375706
SociJam  https://jvz2.com/c/202927/309649
Soronity  https://jvz6.com/c/202927/368736
SqribbleEbook   https://jvz6.com/c/202927/283867
Stackable Picture   https://jvz1.com/c/202927/385046/
Steven Alvey’s   https://jvz2.com/c/202927/351754
Stoodaio   https://jvz1.com/c/202927/372094
Storymate    https://jvz3.com/c/202927/320972
StreamPilot   https://jvz2.com/c/202927/385431/
Studioninja   https://jvz1.com/c/202927/374965
Sunday Freebie  https://jvz1.com/c/202927/267113/
Super backdrop   https://jvz8.com/c/202927/376524
Survai    https://jvz8.com/c/202927/380933/
Syndranker    https://jvz3.com/c/202927/378143/
Talkingfaces   https://jvz3.com/c/202927/375550
The Internet Marketing   https://jvz2.com/c/202927/289944
Tonai Voice Content   https://jvz8.com/c/202927/383119/
Toon Video Maker    https://jvz2.com/c/202927/357201
TrafficForU   https://jvz3.com/c/202927/381950/
Trendio  https://jvz3.com/c/202927/381003/
TubePal   https://jvz6.com/c/202927/379863/
Tubeserp   https://jvz3.com/c/202927/370472
TubeTargeter  https://jvz6.com/c/202927/377211
TuneMingo    https://jvz3.com/c/202927/386556/
TV Boss Fire  https://jvz6.com/c/202927/379480/
Ultrafunnels A.I   https://jvz2.com/c/202927/381129/
VIADZ Ad Template  https://jvz4.com/c/202927/379307/
Vidcentric   https://jvz4.com/c/202927/376095
Viddeyo    https://jvz6.com/c/202927/382326/
Videevolve   https://jvz4.com/c/202927/381011/
Video Campaignor      https://jvz4.com/c/202927/387058/
Video Games   https://jvz3.com/c/202927/184902/
VideoEnginePro     https://jvz2.com/c/202927/372916
VideoGameSuite    https://jvz3.com/c/202927/366537/
VideoRobot Enterprise   https://jvz8.com/c/202927/291061
VidKreate   https://jvz6.com/c/202927/386029/
VidMingo   https://jvz6.com/c/202927/378359/
VidRaffle   https://jvz2.com/c/202927/386840/
VidSnatcher    https://jvz3.com/c/202927/342585
VidVoicer    https://jvz1.com/c/202927/379983/
Vidzura   https://jvz4.com/c/202927/385754/
Viral dash   https://jvz6.com/c/202927/375959
Viral Quotes      https://jvz2.com/c/202927/386984/
VirtualReel   https://jvz8.com/c/202927/376849
Vocalic  https://jvz2.com/c/202927/383848/
VoiceBuddy    https://jvz1.com/c/202927/342854
WebCop  https://jvz4.com/c/202927/378683/
Webinarkit   https://jvz3.com/c/202927/383937/
Webprimo   https://jvz1.com/c/202927/379455/
WordPress Mastery   https://jvz1.com/c/202927/386249/
WowBackgraounds   https://jvz2.com/c/202927/381556/
WP GDPR    https://jvz8.com/c/202927/299907
WP Simulator    https://jvz3.com/c/202927/46987/
Writer Arc   https://jvz1.com/c/202927/386602/
writing job   https://jvz8.com/c/202927/213027
XBrain Forex   https://jvz3.com/c/202927/372305/
XFUNNELS   https://jvz2.com/c/202927/310335
Xinemax  https://jvz1.com/c/202927/381749/
YoDrive   https://jvz2.com/c/202927/384700/
YoSeller   https://jvz4.com/c/202927/387544/
Your 3DPal   https://jvz2.com/c/202927/381685/
YTSuite   https://jvzoo.com/c/202927/381179
Zappable    https://jvz1.com/c/202927/367328/
Pcommerce   https://jvz6.com/c/202927/372265/

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: