Inside a radical new project to democratize AI, researchers have developed a large language model (LLM) called BLOOM. Unlike other popular LLMs like OpenAI's GPT-3 and Google's LaMDA, BLOOM aims to be transparent by sharing details about its training data, development challenges, and performance evaluation. This project, called BigScience, involved over 1,000 volunteer researchers and was coordinated by AI startup Hugging Face with funding from the French government. One of the key selling points of BLOOM is its accessibility. It can be downloaded and experimented with for free on Hugging Face's website, allowing AI developers to use it as a foundation for their own applications.

Glasp

Hatched by Glasp

Jul 16, 2023

4 min read

0

Inside a radical new project to democratize AI, researchers have developed a large language model (LLM) called BLOOM. Unlike other popular LLMs like OpenAI's GPT-3 and Google's LaMDA, BLOOM aims to be transparent by sharing details about its training data, development challenges, and performance evaluation. This project, called BigScience, involved over 1,000 volunteer researchers and was coordinated by AI startup Hugging Face with funding from the French government. One of the key selling points of BLOOM is its accessibility. It can be downloaded and experimented with for free on Hugging Face's website, allowing AI developers to use it as a foundation for their own applications.

With 176 billion parameters, BLOOM surpasses OpenAI's GPT-3 in size. BigScience claims that it offers similar levels of accuracy and toxicity as other models of the same magnitude. Unlike most big tech companies that keep their cutting-edge LLMs restricted, BLOOM's creators are sharing information about its inner workings. This departure from the norm is not entirely unprecedented, as Meta released its own large language model, Open Pretrained Transformer (OPT-175B), along with its code and training logbook. However, Meta's model is only available upon request and has limited usage rights for research purposes. Hugging Face takes it a step further by launching a Responsible AI License, which acts as a terms-of-service agreement, discouraging the use of BLOOM in high-risk sectors or with malicious intent.

The ethical guidelines for BLOOM's development were established from the project's inception. Giada Pistilli, Hugging Face's ethicist, drafted BLOOM's ethical charter, which served as guiding principles throughout the model's creation. One of the ways BLOOM improved upon existing models was by enlisting volunteers from around the world to build suitable datasets, even for languages that were underrepresented online. Companies like OpenAI have refrained from releasing their models and code to the public due to concerns about the sexist and racist language that may be present. However, having an open language model available for research purposes can have a significant long-term impact.

In the realm of UX (user experience) learning, knowledge organization plays a crucial role. To transform information into knowledge, it is essential to develop a perspective that recognizes connections and cultivate learning habits. While it is often emphasized that UX professionals should be well-versed in various fields, there are limited opportunities to learn how to connect information from different domains and turn them into knowledge. It is important to approach learning in a way that expands knowledge like a network.

When it comes to UX, having a broad understanding of different disciplines can greatly enhance one's ability to create meaningful and effective experiences for users. By exploring various fields such as psychology, design, technology, and business, UX professionals can gain insights and perspectives that inform their decision-making processes. This interdisciplinary approach helps in crafting holistic solutions that address the diverse needs and preferences of users.

Furthermore, developing a habit of regularly organizing and synthesizing knowledge is crucial for UX professionals. This involves not only acquiring new information but also actively seeking connections and patterns between different concepts. By structuring knowledge in a coherent manner, designers can better apply their understanding to real-world problems and create more intuitive and user-friendly experiences.

Incorporating unique ideas or insights into the article, it is worth noting that democratizing AI and promoting responsible AI usage are interconnected goals. By making AI models more accessible and transparent, projects like BLOOM pave the way for a more inclusive and equitable AI community. The Responsible AI License introduced by Hugging Face serves as a necessary safeguard against potential misuse of AI technologies in sensitive domains.

Before concluding, here are three actionable pieces of advice for both AI developers and UX professionals:

  1. Embrace transparency and open collaboration: Following the footsteps of projects like BLOOM, consider sharing details about your AI models, such as training data, development challenges, and evaluation methods. Collaboration and knowledge sharing can lead to groundbreaking advancements and a more responsible AI community.

  2. Foster interdisciplinary learning: For UX professionals, actively seek opportunities to expand your knowledge beyond the boundaries of your field. Explore diverse domains that impact user experience, such as psychology, design, technology, and business. This interdisciplinary approach will enable you to create more impactful and user-centric designs.

  3. Cultivate knowledge organization habits: Develop a habit of regularly organizing and synthesizing knowledge. Find effective methods, such as mind mapping or note-taking systems, that work for you. By structuring your knowledge in a meaningful way, you'll be better equipped to apply it to real-world challenges and make informed decisions.

In conclusion, the project to democratize AI through models like BLOOM represents a significant step towards a more transparent and accessible AI landscape. By sharing information, promoting responsible AI usage, and fostering interdisciplinary learning, we can harness the full potential of AI while ensuring it benefits society as a whole.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣