Elon Musk admits xAI has used OpenAI models to train Grok by distillation
Distillation is the practice of transmitting the learnings of one AA model to another, so that a smaller model can imitate the behavior of larger neural networks.
xAICEO Elon Muskhas acknowledged using OpenAI artificial intelligence (AA) models to train Grok's own models and improve their functioning through distillation techniques .
This technique allows the knowledge of one artificial intelligence model to be transferred to another, so that a smaller model (model student) copies the behavior of larger neural networks (model teacher), learning from their predictions and data.
In this regard, Musk has pointed out that Grok has trained the models "partly" through distillation with OpenAI models, which he said is "common practice using other artificial intelligence to validate your AA."
The director of xAI has admitted this to a federal court in California, United States, in the context of the lawsuit filed against the OpenAI company led by Sam Altman, who was sued by Musk for moving away from OpenAI's original non-profit perspective to become a lucrative entity.
Specifically, when asked whether xAI has distilled OpenAI technology, Musk alleges that this technique is "generally used by all AA companies." However, when asked by the jury about the Grok case, the director has replied "partly" , confirming that ChatGPT models have been used to improve Grok.
while the owner of the social network X claims that distillation is a widespread activity in the industry, OpenAI and Anthropic have previously reported similar practices, but so far these allegations have been limited to Chinese companies.
You might like
Ukraine has launched more than 350 drones into Russia, including Moscow and St. Petersburg
The day before, attacks by the Russian Army on several cities in Ukraine resulted in at least 21 deaths and more than 100 injuries.
Trump signs an executive order restricting undocumented migrants' access to the financial system
According to the Republican president, access to national banking systems "must be only for those who have the legal right to stay in the country," and for those who "engage in legal trade."
Russia has launched a massive attack on Ukraine that has left at least 20 dead and more than a hundred injured
Moscow has described the bombing as a "response to the Kiev regime's terrorist attacks."
Trump lashes out at Netanyahu for his attacks on Lebanon: "You're crazy."
According to the US president, an agreement could be reached next week to end the war in Iran and open the Strait of Hormuz. On the contrary, Tehran has announced the suspension of talks with Washington .
Trump Announces Cessation of Israeli Attacks on Lebanon and Hezbollah on Israel
"I have had a very fruitful call with Israeli Prime Minister Netanyahu, no troops are going to Beirut, and those on the way are back," Trump explained in a social media message.
Iran insists that Lebanon enters into a ceasefire agreement and warns that Israeli attacks will have consequences
Despite the ceasefire, Israel's Prime Minister Binyamin Netanyahu has in recent hours ordered the army to bomb the Beirut region of Hezbollah as its stronghold.
One dead, dozens wounded, nearly 900 arrested and 178 officers beaten in the riots following the PSG victory
The Minister of the Interior has explained that 45% more arrests were made than last year, when a large police apparatus was deployed across the country in anticipation of riots. French President Emmanuel Macron said he was "fed up with unacceptable scenes of violence."
Colombia's far-right wins the first round, and the left questions the computing system
The far-right Abelardo de la Espirella has advanced left on Sunday in the first round of the Colombian elections, which will take place on June 21 and will face the left-wing candidate Ivan Cepeda.
A man recently returned from Congo has been isolated in Sardinia, Italy, on suspicion of Ebola
The man returned from the capital of the Democratic Republic of the Congo on a flight that landed in Rome yesterday, Saturday, and then took another flight to Sardinia, where he reported that he had been in a fever for several days.
France calls for an urgent meeting of the UN Security Council for Israeli operations in Lebanon
In mid-April, Israel established a "yellow line" (such as the one it applies in Gaza) that runs about ten kilometres from the border between the two countries, and the perimeter between them was invaded by Israeli troops.