wired_parrot shares a report from the BBC: Released in 1982, Entombed was far from a best-seller and today it's largely forgotten. But recently, a computer scientist and a digital archaeologist decided to pull apart the game's source code to investigate how it was made. An early maze-navigating game, Entombed intrigued the researchers for how early programmers solved the problem of drawing a solvable maze that is drawn procedurally. But they got more than they bargained for: they found a mystery bit of code they couldn't explain (Link to full paper). The fundamental logic that determines how the maze is drawn is locked in a table of possible values written in the games code. However, it seems the logic behind the table has been lost forever.

This week Stack Overflow's CEO/founder Joel Spolsky spoke to Clive Thompson, the tech journalist who just published the new book Coders: the Making of a New Tribe and the Remaking of the World . "It's a sort of ethnographic history of this particular tribe," explains a blog post at Stack Overflow, "examining how software developers fit into the world of business and culture and how their role in society has shifted in recent decades.

"The official conversation kicked off after a 15-minute tangent on Joel's collection of Omni magazine and the formative role this publication had for both men." Some excerpts: Clive: The question in my mind is, who is interested in this? What gets them bit by the bug so they are willing to crawl over all the broken glass that is the daily work.

Joel: In my time, it was the absolute control. Whatever code you wrote, that's what executed. There was no translation. It wasn't like, well the flour was kind of old, and I tried to make the souffle but it collapsed. Unlike so many things you will try to accomplish as a child or an adult, where you work on something but it doesn't turn out as you expect it to, with code it will do exactly what you told it. Even if that's not what you meant. You might suddenly realize you're obeying me to the point of making me angry.

Clive: The monkey's paw thing. I shouldn't have wished for that.

Joel: But the computer is still being completely obedient.

Clive: That thrill is a common thread I found in my research, from the 1960s through today. I will talk to people in their 80s who worked on machines the size of an entire room, and it's the same damn thing talking to a 15-year-old girl at an afterschool program working on a raspberry pi or P5. There is something unique about the micro-world that is inside the machine, qualitatively different from our real world.

Joel: It's sort of utopian. Things behave as they are supposed to. The reason I put a question mark on that, as programmers move higher and higher up the abstraction tree, that kinda goes away.

Clive: I think the rise of machine learning is an interesting challenge to the traditional craft of software development. Some of the people I spoke with for the book aren't interested in it because they don't like the idea of working with these indeterminate training systems... there is something unsettling about not really knowing what's going on with what you're building.

Joel: I just picked up Arduino a year ago and that was enormously fun because it was like going back to C, instead of all these fancy high-level languages where you don't know what they are going to do. It offered a really detailed level of control. If something doesn't work, you can figure it out, because everything is tractable.
They also discussed the future of coding -- and took a fond look back at its past. Spolsky remembers his first exposure to computers was an interactive terminal system connected to a mainframe that ran FORTRAN, BASIC, and PL/I programs. "Many, many years later I realized there was no way they had enough memory for three compilers and in fact what they had was a very simple pre-processsor that made Basic, FORTRAN, and PL/I all look like the same mush.

"It was a very crappy subset of each of those three languages."

An anonymous reader quotes Tom's Hardware: One Raspberry Pi can make a nice web server, but what happens if you put more than 1,000 of them together? At Oracle's OpenWorld convention on Monday, the company showed off a Raspberry Pi Supercomputer that combines 1,060 Raspberry Pis into one powerful cluster.

According to ServeTheHome, which first reported the story, the supercomputer features scores of racks with 21 Raspberry Pi 3 B+ boards each. To make everything run well together, the system runs on Oracle Autonomous Linux... Every unit connects to a single rebranded Supermicro 1U Xeon server, which functions as a central storage server for the whole supercomputer. The Oracle team also created custom, 3D printed brackets to help support all the Pis and connecting components...

ServeTheHome asked Oracle why it chose to create a cluster of Raspberry Pis instead of using a virtualized Arm server and one company rep said simply that "...a big cluster is cool."

intensivevocoder writes: Bryan Bogensberger's exit from npm, inc was quietly announced Friday afternoon in a press release stating that Bogensberger "resigned effective immediately to pursue new opportunities." This marked likely one of the few quiet actions in Bogensberger's tumultuous tenure as CEO of npm, the popular package manager of Node.js. Bogensberger started as CEO on January 9 this year, as part of a move announced by original author and co-founder Isaac Z. Schlueter as part of a plan to commercialize the service. Bogensberger's involvement with the company started in mid-2018, although he was not formally named CEO until 2019 pending the resolution of visa requirements. "Commercializing something like this without ruining it is no small task, and building the team to deliver on npm's promise is a major undertaking. We've sketched out a business plan and strategy for the next year, and will be announcing some other key additions to the team in the coming months," Schlueter wrote in January.

Facebook revealed Friday that it had suspended "tens of thousands" of apps that may have mishandled users' personal data, [Editor's note: the link may be paywalled; alternative source] part of an investigation sparked by the social giant's entanglement with Cambridge Analytica. From a report: The suspensions -- far more than the hundreds against which Facebook has taken action against in the past -- occurred for a "variety of reasons," the company said in a blog post, without elaborating. They were associated with about 400 developers. Facebook said it had investigated millions of apps and targeted those that Facebook said had access to "large amounts of information" or had the "potential to abuse" its policies. Facebook said some of the apps were banned for inappropriately sharing users' data, the same violation of company policy that led to the Cambridge Analytica scandal. It added that its investigation, now 18 months long, isn't yet complete.

Just how important will the ability to write computer code be to a successful career on Wall Street? From a report: According to R. Martin Chavez, an architect of Goldman Sachs Group's effort to transform itself with technology, "It's like writing an English sentence." As Chavez prepares to leave the company, the onetime commodities staffer who rose to posts overseeing technology and ultimately trading is reflecting on his "26-year adventure" in the industry. "The short, short description of it is making money, capital and risk programmable," he said in a Bloomberg Television interview. "There are certainly many kinds of manual activities that computers are just better at."

Chavez, 55, outlined strengths that can help humans stay relevant, such as their relationship skills and ability to assess risks. Yet he predicted that longstanding career dichotomies on Wall Street, like trader versus engineer, will go away. To keep working, people will need both of those skills. Even money is going digital, a shift that goes far beyond cryptocurrencies, he said, pointing to the success of Stripe as an example of creating new ways to move funds. Stripe, for its part, has become one of the most valuable companies in Silicon Valley.

An anonymous reader quotes a report from Ars Technica: Sega and Sports Interactive have announced that Football Manager 2020 will be sold in new eco-friendly package that uses much less plastic, and they're pushing for the rest of the entertainment industry to follow suit. The new packaging replaces the now-standard plastic DVD case used for most game discs with a folded, reinforced cardboard sleeve made of 100% recycled fiber. The shrinkwrap surrounding that package has also been replaced with a low-density LDPE polyethylene that's highly recyclable. Even the ink on the cardboard has been changed out for a vegetable-and-water-based version (so it's technically vegan if you're desperate for a snack).

The new packaging does cost a bit more to produce -- about 20 (British) cents per unit (or 30 percent), according to an open letter from Sports Interactive Studio Director Miles Jacobson. But those costs are somewhat offset by reduced shipping and destruction costs for excess units, he added. And as Spanish footballer Hector Bellerin says in a video accompanying the letter, "if there's no Earth, there's no money to spend." All told, Jacobson says the new packaging will save 55 grams of plastic per unit, or 20 tonnes across a print run of over 350,000. That's an extremely tiny dent in the estimated 335 million tons of plastic that is produced annually worldwide. But Jacobson hopes it could add up to a sizable dent if the entire industry follows suit for the tens of millions of discs it produces each year. "We're not the biggest game in the world," Jacobson said. "Imagine what happens if every other game, every film company, every music company switches to this packaging... So I'm throwing down the gauntlet here to ALL entertainment companies who use plastic for their Blu Ray, DVD and CD packaging."

A scam. A publicity stunt. Premature. These are just a few of the things Chinese developers are saying about the release of Huawei's supposed secret weapon: The Ark Compiler. From a report: Developers are even claiming the program feels incomplete. The reception has been so bad that one programmer told Abacus that he wondered whether it was released just for publicity. "Maybe they're doing it to help in the PR and trade war, adding leverage against the US," said Max Zhou, co-founder of app-enhancement company MetaApp and former head of engineering at Mobike. The Ark Compiler is a key component of Huawei's new operating system, HarmonyOS. The tool is meant to allow developers to quickly port their Android apps to the new OS, ideally helping to quickly bridge the gap of app availability. It is also said to be able to improve the efficiency of Android apps, making them as smooth as apps on iOS. As of right now, though, developers say promises are too good to be true.

Who should be responsible for maintaining and troubleshooting open-source projects? From a report: When you buy a product like Philips Hue's smart lights or an iPhone, you probably assume the people who wrote their code are being paid. While that's true for those who directly author a product's software, virtually every tech company also relies on thousands of bits of free code, made available through "open-source" projects on sites like GitHub and GitLab. Often these developers are happy to work for free. Writing open-source software allows them to sharpen their skills, gain perspectives from the community, or simply help the industry by making innovations available at no cost. According to Google, which maintains hundreds of open-source projects, open source "enables and encourages collaboration and the development of technology, solving real-world problems."

But when software used by millions of people is maintained by a community of people, or a single person, all on a volunteer basis, sometimes things can go horribly wrong. The catastrophic Heartbleed bug of 2014, which compromised the security of hundreds of millions of sites, was caused by a problem in an open-source library called OpenSSL, which relied on a single full-time developer not making a mistake as they updated and changed that code, used by millions. Other times, developers grow bored and abandon their projects, which can be breached while they aren't paying attention. It's hard to demand that programmers who are working for free troubleshoot problems or continue to maintain software that they've lost interest in for whatever reason -- though some companies certainly try. Not adequately maintaining these projects, on the other hand, makes the entire tech ecosystem weaker. So some open-source programmers are asking companies to pay, not for their code, but for their support services. Daniel Stenberg is one of those programmers. He created cURL, one of the world's most popular open-source projects.

In 107 days, Python 2 -- first released in 2000 -- will officially sunset, according to an announcement this week by "volunteers who make and take care of the Python programming language."

But according to TechRepublic, not everybody is ready: Given Python's popularity and ubiquity, the amount of business logic hinging on Python is quite vast, presenting an issue for organizations still clinging to Python 2. JPMorgan's Athena trading platform is one of those applications -- while access has only been available directly to clients since 2018, the Athena platform is used internally at JPMorgan for pricing, trading, risk management, and analytics, with tools for data science and machine learning. This extensive feature set utilizes over 150,000 Python modules, over 500 open source packages, and 35 million lines of Python code contributed by over 1,500 developers, according to data presented by Misha Tselman, executive director at J.P. Morgan Chase in a talk at PyData 2017.

Migrating 35 million lines of code from Python 2 to Python 3 is quite the undertaking -- and JPMorgan is going to miss the deadline, according to eFinancialCareers, stating that JPMorgan's roadmap puts "most strategic components" compatible with Python 3 by the end of Q1 2020 -- that is, three months after the end of security patches -- with "all legacy Python 2.7 components" planned for compatibility with Python 3 by Q4 2020.

Modern developer practices are needed to maintain a project of this scale -- fortunately, JPMorgan uses Continuous Delivery, with 10,000 to 15,000 production changes per week, according to Tselman.
The eFinancialCareers site argues that banks "have been dragging their feet," adding that JPMorgan is not the only bank that still hasn't migrated to Python 3.

The Python volunteers are pointing concerned individuals to the Python 2.7 Countdown Clock, and their announcement also links to a list of support and migration vendors, adding "If you can pay to hire someone to help you, post on the job board or hire a consultant. If you need free help from volunteers, look at this help page."

An anonymous reader quotes ZDNet: While Sun open-sourced some of Java as long ago as November 2006, actually using Java in an open-source way was... troublesome. Just ask Google about Android and Java. But for Java in the enterprise things have changed. On September 10, The Eclipse Foundation announced the full open-source release of the Jakarta EE 8 Full Platform and Web Profile specifications and related Technology Compatibility Kits (TCKs).

This comes after Oracle let go of most of Java Enterprise Edition's (JEE) intellectual property. Oracle retains Java's trademarks though -- thus Java EE's naming convention has been changed to Jakarta EE. But for practical programming and production purposes Jakarta EE 8 is the next generation of enterprise Java.... Jakarta EE 8 also includes the same APIs and Javadoc using the same programming model Java developers have always used. The Jakarta EE 8 TCKs are based on and fully compatible with Java EE 8 TCKs. All of this means enterprise customers will be able to migrate to Jakarta EE 8 without any changes to Java EE 8 applications.

Eclipse hasn't been doing this in a vacuum. Fujitsu, IBM, Oracle, Payara, Red Hat, Tomitribe, and other members of what was once the Java community have been working on Jakarta EE... All of the Jakarta EE Working Group vendors intend to certify their Java EE 8 compatible implementations as Jakarta EE 8 compatible. In other words, Jakarta is the future for Java EE.
Oracle is now working on delivering a Java EE 8 and Jakarta EE 8 compatible implementation of their WebLogic Server.

The Eclipse Foundation says Jakarta EE 8's release "provides a new baseline for the evolution and innovation of enterprise Java technologies under an open, vendor-neutral, community-driven process."

Google's previewing something new in the SDK for their Dart programming language: machine learning-powered automatic code completion.

ZDNet reports: ML Complete works with the editor to offer developers completions as they type their code. It's also meant to help developers quickly explore lists of completions that are likely to be what they want next, rather than having to sort through options alphabetically. "With code completions, developers can both avoid misspellings and explore APIs by typing the beginning of expected symbols and choosing from the offered completions," explains Google project manager Michael Thomsen in his article, 'Announcing Dart 2.5: Supercharged development'.

Google's take on AI-powered code completion for Dart relies on a model trained on a large body of Dart code on GitHub. The model is powered by Google's TensorFlow Lite deep-learning framework and can predict what developers will type next as they're editing code.
ML Complete is built into the Dart analyzer, meaning the preview is available in "Dart-enabled editors" including Android Studio, IntelliJ, and VS Code.

Almost a year ago, Discord launched its own games store and overhauled the Nitro subscription service to offer access to a library of games in addition to other chat and server related perks. From a report: The app's store has gone through several changes over the year, with games ultimately being sold directly through developers' Discord servers instead of the original dedicated portal. However, the library of games Nitro subscribers get access to is getting axed, and its because almost nobody actually played them, per Discord. "We learned a lot from all of you over the last year. Through your valuable feedback, it became clear that while we and some of you love these games, the truth is the vast majority of Nitro subscribers didn't play them," said the company in a blog post today.

"So, after careful consideration, we won't be hitting Continue when these contracts come up for renewal. The removal affects users who are registered for the $9.99 per month (or the $99.99 annual) Nitro subscription, who will no longer be able to play the almost 100-strong catalog of games -- seen on the left image -- from October 15, 2019. To those who may have been caught off guard by the announcement and want to cancel Nitro, Discord is also offering refunds on the subscription.

urdak writes: Four years ago, ScyllaDB introduced Scylla -- a new open-source NoSQL database, compatible with the popular Cassandra but 10 times faster. Today, the project announced support for the DynamoDB API as well. This will allow applications that use Amazon's DynamoDB to be migrated to other public or private clouds -- running on Scylla instead of DynamoDB. Beyond the added choice, large users may also see their cloud bills drastically reduced by moving to Scylla: ScyllaDB reported in the past that the total cost of running Scylla is only one seventh the cost of DynamoDB.

An anonymous reader shares a report: When Microsoft bought 6Wunderkinder, the developer of Wunderlist, in 2015, officials said they planned to shut down that task-management app at some point and replace it with its own To Do app. That move still hasn't happened. But this week, Microsoft is rolling out a redesign of To Do that attempts to make it look more like Wunderlist. On September 9, Microsoft introduced the redesigned To Do, which has smaller headers and more colors. The app is more customizable now with a variety of backgrounds, "including the beloved Berlin TV tower that was a feature in Wunderlist." The app can sync across Mac, iOS, Android, Windows and the Web. And it integrates with Microsoft work or school email accounts; hosted email accounts like Outlook, Hotmail or Live; Microsoft Planner; and Microsoft Launcher on Android. Just so it happens, last week Wunderlist founder Christian Reber said that he'd like to buy Wunderlist back from Microsoft. Today he tweeted "GREAT timing," in regards to Microsoft's To Do makeover.

Top spots in App Store search results are some of the most fought over real estate in the online economy. The store generated more than $50 billion in sales last year, and the company said two-thirds of app downloads started with a search. But as Apple has become one of the largest competitors on a platform that it controls, suspicions that the company has been tipping the scales in its own favor are at the heart of antitrust complaints in the United States, Europe and Russia. From a report: Apple's apps have ranked first recently for at least 700 search terms in the store, according to a New York Times analysis of six years of search results compiled by Sensor Tower, an app analytics firm. Some searches produced as many as 14 Apple apps before showing results from rivals, the analysis showed. (Though competitors could pay Apple to place ads above the Apple results.) Presented with the results of the analysis, two senior Apple executives acknowledged in a recent interview that, for more than a year, the top results of many common searches in the iPhone App Store were packed with the company's own apps. That was the case even when the Apple apps were less relevant and less popular than ones from its competitors. The executives said the company had since adjusted the algorithm so that fewer of its own apps appeared at the top of search results.

The Times's analysis of App Store data -- which included rankings of more than 1,800 specific apps across 13 keywords since 2013 -- illustrated the influence as well as the opacity of the algorithms that underpin tech companies' platforms. Those algorithms can help decide which apps are installed, which articles are read and which products are bought. But Apple and other tech giants like Facebook and Google will not explain in detail how such algorithms work -- even when they blame the algorithm for problems. [...] On Aug. 21, Apple apps ranked first in 735 of roughly 60,000 search terms tracked by Sensor Tower. Most of the tracked searches were obscure, but Apple's apps ranked first for many of the popular queries. For instance, for most of June and July, Apple apps were the top result for these search terms: books, music, news, magazines, podcasts, video, TV, movies, sports, card, gift, money, credit, debit, fitness, people, friends, time, notes, docs, files, cloud, storage, message, home, store, mail, maps, traffic, stocks and weather. In July this year, the company pushed some changes to its app store algorithm to handicap its apps to help other developers, it told The New York Times.

ZDNet remembers when the only programming languages "were machine and assembler," until Burroughs Corporation programmer Mary Hawes proposed a vendor-neutral language with an English-like vocabulary. (Grace Hopper suggested they approach the Department of Defense, leading to a summit of 41 computer users and manufacturers at the Pentagon in 1959.)

But ZDNet argues that 60 years later, COBOL isn't done yet. In 2016, the Government Accountability Office reported the Department of Homeland Security, Department of Veterans Affairs, and the Social Security Administration, to name just three, were still using COBOL. According to a COBOL consulting company, which goes by the delightful name, COBOL Cowboys, 200 billion lines of COBOL code are still in use today and 90% of Fortune 500 companies still having COBOL code keeping the lights on. And, if you've received cash out of an ATM recently, it's almost certain COBOL was running behind the scenes.
ZDNet explains that's the largest number of businesses using COBOL are financial institutions, which, according to Micro Focus includes "banking, insurance and wealth management/equities trading. Second is government services (federal, provincial, local)." Micro Focus is the company that now maintains COBOL, and their global director of marketing and "application modernization" tells ZDNet that "the number of organizations running COBOL systems today is in the tens of thousands. It is impossible to estimate the tens of millions of end users who interface with COBOL-based applications on a daily basis, but the language's reliance is clearly seen with its use in 70 percent of global transaction processing systems. Any time you phone a call center, any time you transfer money, or check your account, or pay a mortgage, or renew or get an insurance quote, or when contacting a government department, or shipping a parcel, or ordering some flowers, or buying something online at a whole range of retailers, or booking a vacation, or a flight, or trading stocks, or even checking your favorite baseball team's seasonal statistics, you are interacting with COBOL.
ZDNet notes that some people are even moving their COBOL applications into the cloud, concluding "At this rate, COBOL programs will outlive us all."

Developers have come to accept that, without warning, Apple can make their work obsolete by announcing a new app or feature that essentially copies their ideas. Some apps have simply buckled under the pressure. The Washington Post: Clue, a popular app women use to track their periods, has risen to near the top of Apple's Health and Fitness category. It could be downhill from here. Apple plans this month to incorporate some of Clue's core functionality such as fertility and period prediction into its own Health app that comes pre-installed in every iPhone and is free, unlike Clue, which earns money by selling subscriptions and services in its free app. Apple's past incorporation of functionality included in other third-party apps has often led to their demise. Clue's new threat shows how Apple plays a dual role in the app economy: provider of access to independent apps and giant competitor to them.

Developers have come to accept that, without warning, Apple can make their work obsolete by announcing a new app or feature that uses or incorporates their ideas. Some apps have simply buckled under the pressure, in some cases shutting down. They generally don't sue Apple because of the difficulty and expense in fighting the tech giant -- and the consequences they might face from being dependent on the platform. The imbalance of power between Apple and the apps on its platform could turn into a rare chink in the company's armor as regulators and lawmakers put the dominance of big technology companies under an antitrust microscope. When Apple made a flashlight part of its operating system in 2013, it rendered instantly redundant a myriad apps that offered that functionality. Everything from the iPhone's included "Measure" app to its built-in animated emoji were originally apps in the App Store.

A change Apple is making to improve privacy in an upcoming version of its iPhone operating system has alarmed an unlikely group of software makers: developers of privacy-focused encrypted messaging apps. The Information (paywalled): They warn the change, which is already available in public test versions of iOS 13, could end up undermining the privacy goals that prompted it in the first place. The Information previously reported that the technical change Apple is making to its next operating systems, iOS 13, has sparked concern at Facebook, which believes it will have to make significant modifications to encrypted messaging apps like Facebook Messenger and WhatsApp to comply. But a much wider group of developers of encrypted messaging apps -- including Signal, Wickr, Threema and Wire -- is scrambling to overhaul their software so that key privacy features continue to work. Apple told The Information on Wednesday in a statement that it is working with the developers to resolve their concerns. "We've heard feedback on the API changes introduced in iOS 13 to further protect user privacy and are working closely with iOS developers to help them implement their feature requests," an Apple spokesperson said.

Independent Scottish developer Muirhall Energy announced on Monday that construction has begun at the Crossdykes Wind Farm, an important step in the company's effort to deliver Scotland's first subsidy-free onshore wind project. CleanTechnica reports: The 46 megawatt (MW) Crossdykes Wind Farm, being developed at Dumfries and Galloway, in the western Southern Uplands of Scotland, is expected to produce first power in September 2020. Muirhall Energy and its partners WWS Renewables reached financial close on the project in August -- believed to be the first subsidy-free development to be project-financed, thanks to funding from Close Brothers Leasing and wind turbines to be supplied by Nordex. Muirhall has also offered the local Dumfries and Galloway community the opportunity to buy up to 10% of the project via a community share offer. "We are delighted to be starting construction on what will be one of the first subsidy-free developments to come online in the UK," said Chris Walker, Managing Director of Muirhall Energy. "That is testament to the work we have done as a company, but also the flexibility shown by all our partners as we finalized our plans for the project."

"We are now very much focused on working to our tight construction timeline and progressing a number of the other projects in our portfolio which we believe can be made to work on a similar model. With more than 300 MW to begin construction over the next three years, this an exciting time for Muirhall Energy."