Coffee with Brian Kernighan - Computerphile

TL;DR

Awk remains useful because it makes quick text-and-number processing concise, often handling simple data tasks in a single line. Brian Kernighan explains that he, Alfred Aho, and Peter Weinberger originally developed it in 1977 with associative arrays and a pattern-action model. It suits short jobs such as inspecting a column or adding numbers, though unexpected pattern matches can make growing programs risky. Read on to understand when Awk is the right tool.

Transcript

welcome back Brian it's been two years that we've missed you now due to covert precautions and you not coming over the Atlantic but here you are yeah one of your colleagues a bit of Weinberger certain Brian kernaghan and a certain Alejo blew us all into the weeds with orc it did so many things were vaguely known about in other languages but which I... Read More

Key Insights

• 😑 Awk's development in 1977 introduced powerful and unique features like associative arrays and extensive regular expression usage, making it a groundbreaking scripting language.
• 🔨 Awk's simplicity and efficiency make it a valuable tool for quick and dirty data processing tasks that don't require the complexity of other languages.
• 🍵 While Python is a popular choice for general-purpose programming, Awk offers specific advantages, such as its ability to handle large volumes of text and perform quick data manipulations.
• ⚾ Awk's pattern match-based approach requires careful handling and thorough testing to avoid unexpected results.
• 👶 Ongoing development and maintenance of Awk are primarily handled by Arnold Robbins, who ensures its compatibility with modern systems and introduces new features like Unicode support.
• 📔 Awk's future may involve improvements in Unicode handling and potential updates to its widely used "The Awk Programming Language" book.
• 🛟 The Unix Heritage Society and the efforts of dedicated individuals have preserved and made available historical Unix software, including variants of Awk.

Questions & Answers

Q: What is Awk good for, and why is it still used?

Awk is good for quickly processing text and numbers within the same program. It automatically handles work such as reading input, splitting it into components, and writing output, so tasks like inspecting a column or adding numbers can be expressed very briefly.

Q: Who developed Awk, and when was it created?

Brian Kernighan developed Awk with Alfred Aho and Peter Weinberger in 1977. Kernighan describes its original development cycle as very short.

Q: When should you use Awk instead of Python?

Awk is useful when Python would be excessive for a quick, simple data-processing job. Kernighan gives examples such as examining a particular column in a collection of fields or adding up numbers, potentially with a one-line program.

Q: How does Awk compare with Python?

Python supports a wide range of programming tasks through its extensive ecosystem of libraries, packages, and modules. Awk is more specialized: its programs tend to be very short because input handling, field splitting, and output happen automatically, while their speed is described as about the same as Python for these tasks.

Q: What is an associative array in Awk?

An associative array is an array whose subscripts can be arbitrary text strings rather than only numbers. Kernighan says it is so useful that, if a language could have only one data structure, associative arrays would be the one to choose because other structures can be built from them.

Q: How does Awk’s pattern-action model work?

An Awk program is a sequence of patterns matched against the input, with an associated action specifying what to do when each pattern matches. A typical program may contain only one pattern and one action, or even just the pattern or the action.

Q: What problems can unexpected pattern matches cause in Awk?

Because Awk decides what to do through pattern matching, programmers must continually consider which patterns will match. Longer lists of regular-expression matches can produce premature, late, or otherwise unexpected matches, so they require careful handling.

Q: When is an Awk program becoming too large?

A very long Awk program may indicate that Awk is no longer the right language for the job and that Python or another preferred language would be more suitable. The difficulty is that Awk programs often begin with one or two small tasks and then grow as more improvements are added.

Summary & Key Takeaways

• Awk, developed by Brian Kernighan, Alfred Aho, and Peter Weinberger, combined text and number processing in the same program, making it a versatile tool for various tasks.

• The language introduced associative arrays, allowing for efficient data manipulation, and its extensive use of regular expressions made it highly capable for pattern matching.

• Awk provides a lightweight and efficient solution for quick and dirty tasks that don't require the complexity of languages like Python, but it requires careful handling due to its pattern match-based nature.