The Day The AGI Was Born: Maths Shows How We Lose Interest

Kazuki

Hatched by Kazuki

Aug 19, 2023

4 min read

0

The Day The AGI Was Born: Maths Shows How We Lose Interest

In a world where technology is advancing at an unprecedented pace, we are constantly witnessing groundbreaking developments. One such development is the birth of an Artificial General Intelligence (AGI), which has the potential to revolutionize the way we interact with machines. However, as exciting as this may sound, there are still limitations to what AGI can achieve.

The AGI, referred to as the "GPT-3.5 series" model, is a fine-tuned version of its predecessor, GPT-3. It excels in zero-shot generation of text that follows specific instructions, making it a valuable tool for tasks such as brainstorming, drafting, and presenting information creatively. With a long-term memory capacity of up to 8192 tokens, it can generate output that is twice as long as GPT-3. However, it is important to note that the AGI still falls short in certain areas.

One of the limitations of the AGI is its inability to perform mathematical calculations accurately. This means that it cannot be relied upon for tasks that require precise calculations. Additionally, the AGI has been found to generate false information about the real world and write faulty code. These shortcomings prevent it from passing Turing, SAT, or IQ tests, further highlighting its limitations.

Despite these limitations, the AGI represents a significant step towards achieving true artificial general intelligence. It is a testament to the advancements made in Reinforcement Learning via Human Feedback. The speed at which progress has been made in this field has surpassed expectations, leading to the birth of AGI sooner than anticipated.

Moving on from the realm of AGI, let us delve into the intriguing world of collective memory and the mathematics behind it. According to neuroscientist David Eagleman, a person only truly dies when they are forgotten. This notion suggests that a person's life continues to exist, albeit in the subconscious minds of others, even if they are forgotten. This concept highlights the importance of continued and shared attention to individuals and events.

Collective memory plays a crucial role in shaping identity and influencing the structures and priorities of society. The choices we make in what to commemorate and remember have a significant impact on how individuals perceive themselves as part of a group. Understanding the decay of collective memory is a complex task, but mathematics provides us with insights into this phenomenon.

A study conducted by C. Candia et al. analyzed various forms of attention as proxies for memory decay. The researchers examined online views of Wikipedia profiles of sports stars, citations of physics papers, patents, and online play counts of songs and film trailers. The analysis revealed that the decay of collective memory follows a biexponential function, characterized by two distinct phases.

The first phase of decay is marked by a rapid decline in attention, primarily driven by word-of-mouth transfer of information, known as communicative memory. This stage is characterized by a steep drop in attention over a relatively short period of time. The second phase, however, exhibits a slower decline in attention, which is sustained by cultural memory, reliant on the physical recording of information.

Interestingly, the study found that different forms of media have varying rates of decay. Music, for instance, experiences the shortest and sharpest initial decline in attention, taking approximately six years. On the other hand, online biographies of sports stars have the longest decline, ranging from 20 to 30 years. This discrepancy can be attributed to the accessibility and searchability of different forms of media.

In conclusion, the birth of AGI and the study of collective memory both provide fascinating insights into the world of technology and human cognition. While the AGI still has limitations that prevent it from achieving true artificial general intelligence, it represents a significant milestone in the field. As for collective memory, the mathematical analysis of its decay sheds light on the importance of continued attention and the impact of cultural and communicative memory.

To make the most of these insights, here are three actionable pieces of advice:

  • 1. Embrace the creativity of AGI: While the AGI may not be accurate in certain tasks, it excels in generating creative content. Utilize its capabilities for brainstorming, drafting, and presenting information in innovative ways.
  • 2. Combine AGI with external assets: To compensate for the inaccuracies of AGI, leverage external resources and assets. By combining the strengths of AGI with reliable sources, you can enhance its output and ensure greater accuracy.
  • 3. Preserve collective memory: Recognize the importance of collective memory in shaping identity and society. Make conscious choices in what to commemorate and remember, as these decisions have a lasting impact on the structures and priorities of our communities.

Both the birth of AGI and the decay of collective memory are fascinating areas of study that continue to captivate researchers and enthusiasts alike. By understanding their limitations and harnessing their unique capabilities, we can navigate the ever-evolving landscape of technology and human cognition with greater insight and purpose.

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)