Agregátor RSS

To everyone’s surprise, Apple is turning weakness into strength with its evolving approach to artificial intelligence (AI), as it becomes one of the biggest open-source research contributors in the field.

Apple last week released its DCLM (dataComp for Language Models) models on HuggingFace. This aims to be a solution for data training and curation, enabling new models to be trained and tested with relatively few “training tokens.”

‘Best performing truly open-source models’

“Our baseline model is also comparable to Mistral-7B-v0.3 and Llama 3 8B on MMLU (63% & 66%) and performs similarly on an average of 53 natural language understanding tasks while being trained with 6.6x less compute than Llama 3 8B,” the team wrote. “Our results highlight the importance of dataset design for training language models and offer a starting point for further research on data curation.”

Apple’s researchers worked with peers from the University of Washington, the Toyota Research Institute, Stanford, and others on the project. 

“To our knowledge these are by far the best performing truly open-source models (open data, open weight models, open training code),” Apple machine learning researcher Vaishaal Shankar wrote when announcing the news. 

Reaction seems positive. “The data curation process is a must-study for anyone looking to train a model from scratch or fine-tune an existing one,” said Applied AI Scientist Akash Shetty 

Opening up, strategically

The model seems to compete strongly with other models of its type, including Mistral-7B, and approaches the performance of models from Meta and Google — even though it is trained on smaller quantities of content. 

The idea is that research teams can use the tech to create their own small AI models, which can themselves be embedded in (say) apps and deployed at low cost.

While it is unwise to read too much into things, Apple’s AI teams do seem to have embraced a more open approach to research in the field. That makes sense for a company allegedly racing to catch up to competitors, of course; it also makes sense in another way, because the company that contributes and maintains code to the open source community puts itself in a strong position for future research in terms of contact with peers and fostering future goodwill.

Collaboration counts

That alone is a small, but remarkable, step for Apple, which has a reputation for prizing secrecy above all else. That secrecy has, we’ve been intermittently told in recent years, been a big problem for Apple’s research teams, who wanted to work in a more collaborative way with others in the cutting-edge industry.

Apple seems to have listened, which is why I think it is now turning what was once a disadvantage into an advantage. In the short-term, the company wants to promote effective innovation in AI while it develops its own solutions under the Apple Intelligence brand.

It might also hope to position itself as a source technology provider powering many open-source projects. Ensuring good technologies are widely available to the open-source community could help prevent other entities owning too much of the core technology. 

Coders on the edge of time

The release of the small-size model also reflects Apple’s core approach toward edge-based AI solutions, supplemented by its own secure server-based AI services and also third-party offers, such as from OpenAI or in future Google Gemini.

The Apple release is just the latest in a string of such releases to have emerged since the company intensified its focus on AI research. The company has now published dozens of models, including most recently its OpenELM and CoreML models. The latter models are optimized to run generative AI (genAI) and machine learning applications on device.

While nothing has been stated to this effect, the cards Apple is showing indicate it is working more closely with researchers outside the company. And it’s investing on the development of edge AI — ironically, the direction the industry will inevitably head toward as the real-life problems of power and water consumption, copyright, and privacy present existential challenges to the future evolution of the server-led AI space. 

Please follow me on Mastodon, or join me in the AppleHolic’s bar & grill and Apple Discussions groups on MeWe.

An unprecedented period for an unparalleled force in cybercrime

Feature  For roughly two years, LockBit's ransomware operation was by far the most prolific of its kind, until the fateful events of February. After claiming thousands of victims, extorting hundreds of millions of dollars, and building a robust army of sophisticated cybercriminals, the life's work of its mastermind, LockbitSupp – whom cops claim is Russian national Dmitry Khoroshev – is now hanging by a thread.…

Certificate authority (CA) DigiCert has warned that it will be revoking a subset of SSL/TLS certificates within 24 hours due to an oversight with how it verified if a digital certificate is issued to the rightful owner of a domain. The company said it will be taking the step of revoking certificates that do not have proper Domain Control Validation (DCV). "Before issuing a certificate to a

Certificate authority (CA) DigiCert has warned that it will be revoking a subset of SSL/TLS certificates within 24 hours due to an oversight with how it verified if a digital certificate is issued to the rightful owner of a domain. The company said it will be taking the step of revoking certificates that do not have proper Domain Control Validation (DCV). "Before issuing a certificate to a Ravie Lakshmananhttp://www.blogger.com/profile/[email protected]

17. června tohoto roku vzplál les v okrese Mason ve státě Washington. Obyvatelé této oblasti žijí rozptýleni mezi hustými lesy a rozeklanými vrcholky Olympijského poloostrova. Nikdo z nich ale nezavolal na tísňovou linku, aby požár ohlásil. Místní hasiči by tak neměli ani tušení, že v jejich okrsku ...

The threat actors behind an ongoing malware campaign targeting software developers have demonstrated new malware and tactics, expanding their focus to include Windows, Linux, and macOS systems. The activity cluster, dubbed DEV#POPPER and linked to North Korea, has been found to have singled out victims across South Korea, North America, Europe, and the Middle East. "This form of attack is an

The threat actors behind an ongoing malware campaign targeting software developers have demonstrated new malware and tactics, expanding their focus to include Windows, Linux, and macOS systems. The activity cluster, dubbed DEV#POPPER and linked to North Korea, has been found to have singled out victims across South Korea, North America, Europe, and the Middle East. "This form of attack is an Ravie Lakshmananhttp://www.blogger.com/profile/[email protected]

A playbook full of strategies and someone fumbles the implementation

Do you have problems configuring Microsoft's Defender? You might not be alone: Microsoft admitted that whatever it's using for its defensive implementation exacerbated yesterday's Azure instability.…

Canonical has fixed several recently identified critical Linux kernel vulnerabilities in July 2024. These vulnerabilities primarily affect Microsoft Azure cloud systems in Ubuntu 16.04 (Extended Security maintenance) and Ubuntu 1804 ESM.

On July 24, 2024, OpenSSL took an extraordinary step toward improving community engagement and realigning with its core values when it announced the implementation of a new governance framework and the launch of several projects under its mission statement. This event marks a historic moment for OpenSSL and Linux administrators worldwide who depend on this foundational technology for secure applications.

Qucs-S byl vydán ve verzi 24.3.0. Qucs-S je simulátor obvodů založený na Qucs (Quite Universal Circuit Simulator) a SPICE (Simulation Program with Integrated Circuit Emphasis).

iPhone a Pixel jako rivalové? Ale kdepak, vždyť jsou to skoro milenci • V originální kampani Googlu spolu prožívají různá dobrodružství • Pixel měl vždy navrch a po roce se oba telefony rozcházejí v dobrém

Byla vydána aktualizace eDokladů (𝕏). Verze 1.5.0., kromě drobných úprav UX, přináší opravy odesílání diagnostických dat. Aplikace odesílala data za účelem detekce a odstraňování chyb, ale nesprávně odesílala i podrobnější informace. Ty byly před zpracováním anonymizovány, jejich odesílání i proto nebylo potřeba.

Japanese organizations are the target of a Chinese nation-state threat actor that leverages malware families like LODEINFO and NOOPDOOR to harvest sensitive information from compromised hosts while stealthily remaining under the radar in some cases for a time period ranging from two to three years. Israeli cybersecurity company Cybereason is tracking the campaign under the name Cuckoo Spear,

Japanese organizations are the target of a Chinese nation-state threat actor that leverages malware families like LODEINFO and NOOPDOOR to harvest sensitive information from compromised hosts while stealthily remaining under the radar in some cases for a time period ranging from two to three years. Israeli cybersecurity company Cybereason is tracking the campaign under the name Cuckoo Spear, Ravie Lakshmananhttp://www.blogger.com/profile/[email protected]

Microsoft uzavřel poslední čtvrtletí fiskálního roku 2024 tržbami ve výši 64,7 miliardy dolarů, čímž o 15 % překonal loňský výsledek. Provozní zisk zvýšil o 15 % na 27,9 miliardy a ten čistý o 10 % na 22 miliard dolarů. Také zisk na akcii vzrostl o 10 % (na 2,95 dolaru), avšak akcionářům ani ...

We’ll TL;DR the FUDdy introduction: we all know that phishing attacks are on the rise in scale and complexity, that AI is enabling more sophisticated attacks that evade traditional defenses, and the never-ending cybersecurity talent gap means we’re all struggling to keep security teams fully staffed.  Given that reality, security teams need to be able to monitor and respond to threats

We’ll TL;DR the FUDdy introduction: we all know that phishing attacks are on the rise in scale and complexity, that AI is enabling more sophisticated attacks that evade traditional defenses, and the never-ending cybersecurity talent gap means we’re all struggling to keep security teams fully staffed.  Given that reality, security teams need to be able to monitor and respond to threats The Hacker Newshttp://www.blogger.com/profile/[email protected]