Goodbye programmers
Back in July, a team of researchers proved that ChatGPT is able to design a simple, producible microchip from scratch in under 100 minutes, following human instructions provided in plain English.
Last month, another group — working at universities in China and the US — decided to take a step further and cut the humans out of the creative process almost completely.
Instead of relying on a single chatbot providing answers to questions asked by a human, they created a team of ChatGPT 3.5-powered bots, each assuming a different role in a software agency: CEO, CTO, CPO, programmer, code reviewer, code tester, and graphics designer.
Each one was briefed about its role and provided details about their behaviour and requirements for communication with other participants, e.g. “designated task and roles, communication protocols, termination criteria, and constraints.”
Other than that, however, ChatDev’s — as the company was named — artificial intelligence (AI) team would have to come up with its own solutions, decide which languages to use, design the interface, test the output, and provide corrections if needed.
Once ready, the researchers then fed their virtual team with specific software development tasks and measured how it would perform both on accuracy and time required to complete each of them.
The dream CEO
The bots were to follow an established waterfall development model, with tasks broken up between designing, coding, testing, and documenting of work done, with each of them assigned their roles throughout the process.
What I found particularly interesting is the exclusion of CEO from the technical aspects of the process. His role is to provide the initial input and return for the summary, while leaving techies and designers to do their jobs in peace — quite unlike in the real world!
I think many people would welcome our new overlords, who are instructed not to interfere with the job until it’s really time for them to. Just think how many conflicts could be avoided!
Once the entire team was ready to go, the researchers then fed their virtual team with specific software development tasks and measured how it would perform both on accuracy and time required to complete each of them.
Here’s an example of fully artificial conversation between all of the “members”:
Later, followed by i.a. this exchange between the CTO and the programmer:
These conversations continued at each stage before its completion and information being passed for interface design, testing, and documentation (like creating a user manual).
Time is money
After running 70 different tasks through this virtual AI software dev company, over 86 per cent of the produced code was executed flawlessly. The remaining about 14 per cent faced hiccups due to broken external dependencies and limitations of ChatGPT’s API — so, it was not a flaw of the methodology itself.
The longest time it took to complete a single task was measured at 1030 seconds, so a little over 17 minutes — with an average of just six minutes and 49 seconds across all tasks.
This, perhaps, is not all that telling yet. After all, there are many tasks, big and small, in software development, so the researchers put their findings in context:
“On average, the development of small-sized software and interfaces using CHATDEV took 409.84 seconds, less than seven minutes. In comparison, traditional custom software development cycles, even within agile software development methods, typically require two to four weeks, or even several months per cycle.”
At the very least, then, this approach could shave off weeks of typical development time — and we are only at the very beginning of the revolution, with still not very sophisticated AI bots (and this wasn’t even the latest version of ChatGPT).
And if time wasn’t enough of a saving, the basic costs of running each cycle with AI is just… $1. A dollar.
Even if we factor in the necessary setup and input information provided by humans, this approach still provides an opportunity for massive savings.
Goodbye programmers?
Goodbye programmers
Perhaps soon, but not yet. Even the authors of the paper admit that even though the output produced by the bots was most often functional, it wasn’t always exactly what was expected (though it happens to humans too — just think of all the times you did exactly what the client asked and they were still furious).
They also recognised that AI itself may exhibit certain biases, and different settings it was deployed with were able to dramatically change output, in extreme cases rendering it unusable. In other words, setting the bots up correctly is a prerequisite to success. At least today.
So, for the time being, I think we’re going to see a rapid rise in human-AI cooperation rather than outright replacement.
However, it’s also difficult to escape the impression that through it we will be raising our successors and, in not so distant future, humans will be limited to only setting goals for AI to accomplish, while mastering programming languages will be akin to learning Latin.
You can download the full paper on arXiv.
Wow, amazing weblog structure! How long have you been running a blog
for? you make running a blog glance easy. The full look of your web site is wonderful,
let alone the content material! You can see similar here sklep internetowy
You actually make it appear really easy with your presentation but
I to find this matter to be actually one thing that I believe I would by
no means understand. It kind of feels too complicated and
extremely large for me. I am looking ahead on your next publish, I’ll try to get the grasp
of it! I saw similar here: E-commerce
Hello! Do you know if they make any plugins to assist
with SEO? I’m trying to get my blog to rank for some targeted
keywords but I’m not seeing very good success.
If you know of any please share. Appreciate it! You can read
similar text here: Sklep internetowy
It’s very interesting! If you need help, look here: ARA Agency
Hey! Do you know if they make any plugins to assist with Search Engine Optimization?
I’m trying to get my blog to rank for some targeted keywords but I’m not seeing very
good gains. If you know of any please share. Cheers!
You can read similar blog here: Najlepszy sklep
Hey there! Do you know if they make any plugins to assist with Search Engine Optimization? I’m trying to get my blog to rank for some targeted keywords but I’m not seeing very good
results. If you know of any please share. Cheers! You can read similar art here: GSA Verified List
Online medicine home delivery http://indiaph24.store/# top 10 pharmacies in india
indian pharmacy paypal
https://mexicoph24.life/# mexico drug stores pharmacies
canadian pharmacy ltd [url=https://canadaph24.pro/#]Licensed Canadian Pharmacy[/url] canadian pharmacy prices
п»їbest mexican online pharmacies: mexican pharmacy – purple pharmacy mexico price list
does tamoxifen cause menopause: nolvadex only pct – tamoxifen 20 mg
order propecia without a prescription [url=https://finasteride.store/#]cost of cheap propecia without a prescription[/url] propecia without insurance
tamoxifen and uterine thickening [url=http://nolvadex.life/#]tamoxifen for gynecomastia reviews[/url] hysterectomy after breast cancer tamoxifen
https://nolvadex.life/# tamoxifen breast cancer
nolvadex half life [url=http://nolvadex.life/#]tamoxifen joint pain[/url] tamoxifen estrogen
buying propecia price: get propecia without rx – buy propecia
http://lisinopril.network/# lisinopril brand name uk
http://ciprofloxacin.tech/# cipro 500mg best prices
cost generic propecia online [url=https://finasteride.store/#]generic propecia online[/url] cheap propecia no prescription
cost of propecia prices: order cheap propecia – cost of cheap propecia price
http://nolvadex.life/# tamoxifen and uterine thickening
rx lisinopril 10mg [url=http://lisinopril.network/#]lisinopril price in canada[/url] on line order lisinopril 20mg
https://cytotec.club/# cytotec pills buy online
order generic propecia without insurance [url=https://finasteride.store/#]buy propecia online[/url] rx propecia
http://nolvadex.life/# tamoxifen therapy
Cytotec 200mcg price: Cytotec 200mcg price – cytotec online
https://cytotec.club/# buy misoprostol over the counter
order propecia without prescription [url=https://finasteride.store/#]propecia brand name[/url] generic propecia without a prescription
lisinopril 25 mg: buy zestril online – lisinopril 4 mg
tamoxifen reviews [url=http://nolvadex.life/#]tamoxifen 20 mg tablet[/url] tamoxifen reviews
https://ciprofloxacin.tech/# ciprofloxacin generic
https://ciprofloxacin.tech/# ciprofloxacin over the counter
is nolvadex legal [url=https://nolvadex.life/#]nolvadex half life[/url] tamoxifen hot flashes
prinivil 40 mg [url=http://lisinopril.network/#]zestril 5 mg tablets[/url] cheap lisinopril 40 mg
purchase lisinopril online: lisinopril 20 mg tablet – lisinopril 2.5 mg medicine
http://cytotec.club/# buy cytotec online
http://lisinopril.network/# prinzide zestoretic
buy propecia tablets [url=https://finasteride.store/#]order propecia pills[/url] buying propecia online
tamoxifen vs raloxifene: tamoxifen menopause – femara vs tamoxifen
http://nolvadex.life/# nolvadex pct
lisinopril for sale [url=http://lisinopril.network/#]buy lisinopril online no prescription[/url] where can i buy zestril
https://finasteride.store/# cost of generic propecia
effexor and tamoxifen [url=http://nolvadex.life/#]does tamoxifen cause joint pain[/url] clomid nolvadex
ciprofloxacin order online: cipro ciprofloxacin – buy ciprofloxacin
https://ciprofloxacin.tech/# ciprofloxacin 500 mg tablet price
http://nolvadex.life/# nolvadex 20mg
buy cytotec pills [url=https://cytotec.club/#]buy cytotec over the counter[/url] Cytotec 200mcg price
cytotec buy online usa: buy cytotec online – Abortion pills online
https://ciprofloxacin.tech/# buy cipro online canada
medication zestoretic [url=https://lisinopril.network/#]cost of lisinopril 30 mg[/url] lisinopril 20
lisinopril 30 mg price: lisinopril mexico – prescription drug lisinopril
http://ciprofloxacin.tech/# buy generic ciprofloxacin
tamoxifen chemo [url=https://nolvadex.life/#]tamoxifen[/url] tamoxifen hormone therapy
https://finasteride.store/# buying generic propecia
zestoretic tabs [url=https://lisinopril.network/#]can i buy lisinopril over the counter in mexico[/url] lisinopril online canada
http://ciprofloxacin.tech/# buy cipro online without prescription
cost cheap propecia without insurance [url=https://finasteride.store/#]buy propecia[/url] order propecia without prescription
buy cipro online without prescription: cipro ciprofloxacin – purchase cipro
http://cytotec.club/# buy cytotec over the counter
sildenafil oral jelly 100mg kamagra: kamagra oral jelly – super kamagra
cheapest cialis [url=http://cialist.pro/#]Cialis 20mg price in USA[/url] Cialis 20mg price in USA
https://cialist.pro/# Cialis 20mg price
http://cialist.pro/# Buy Tadalafil 10mg
Viagra tablet online [url=https://viagras.online/#]Cheapest place to buy Viagra[/url] Viagra generic over the counter
Buy Tadalafil 5mg: Generic Tadalafil 20mg price – Generic Cialis without a doctor prescription
https://kamagra.win/# Kamagra 100mg price
Buy Cenforce 100mg Online: Purchase Cenforce Online – cenforce for sale
Cenforce 150 mg online [url=http://cenforce.pro/#]cheapest cenforce[/url] Purchase Cenforce Online
cialis for sale: cialist.pro – Cialis 20mg price
http://viagras.online/# Cheap Viagra 100mg
п»їBuy generic 100mg Viagra online [url=https://viagras.online/#]viagras.online[/url] Viagra tablet online
http://viagras.online/# viagra canada
cheap kamagra: kamagra oral jelly – Kamagra 100mg price
http://kamagra.win/# buy Kamagra
https://kamagra.win/# sildenafil oral jelly 100mg kamagra
п»їBuy generic 100mg Viagra online [url=http://viagras.online/#]Sildenafil 100mg price[/url] Cheap generic Viagra online
Sildenafil Citrate Tablets 100mg: Buy Viagra online cheap – Viagra online price
cheapest cenforce: order cenforce – cenforce for sale
http://cenforce.pro/# cenforce.pro
buy kamagra online usa [url=http://kamagra.win/#]buy kamagra online[/url] Kamagra 100mg
indianpharmacy com: indian pharmacy – best india pharmacy
non prescription medicine pharmacy [url=http://pharmworld.store/#]cheapest pharmacy[/url] prescription free canadian pharmacy
http://pharmcanada.shop/# canadian pharmacy no scripts
https://pharmcanada.shop/# canada pharmacy reviews
onlinepharmaciescanada com: canadianpharmacymeds com – legitimate canadian pharmacies
no prescription online pharmacy [url=http://pharmnoprescription.icu/#]canada pharmacy online no prescription[/url] buying online prescription drugs
best online pharmacies in mexico: best mexican online pharmacies – mexico pharmacies prescription drugs
purple pharmacy mexico price list: pharmacies in mexico that ship to usa – mexico pharmacies prescription drugs
https://pharmindia.online/# mail order pharmacy india
canadianpharmacy com [url=https://pharmcanada.shop/#]canadianpharmacyworld[/url] canadian pharmacy victoza
cheapest online pharmacy india: top 10 pharmacies in india – Online medicine home delivery
http://pharmworld.store/# canadian pharmacy discount coupon
canadian pharmacy 24h com [url=http://pharmcanada.shop/#]safe canadian pharmacies[/url] canadian mail order pharmacy
mexican mail order pharmacies: buying from online mexican pharmacy – buying prescription drugs in mexico
pharmacy no prescription: best no prescription online pharmacy – buy drugs online without a prescription
https://pharmworld.store/# canadian pharmacy coupon
canadian pharmacy 24 com: northwest canadian pharmacy – canadian pharmacy world
best india pharmacy [url=https://pharmindia.online/#]indianpharmacy com[/url] Online medicine home delivery
online pharmacy india: best online pharmacy india – indianpharmacy com
http://pharmindia.online/# indian pharmacy
canada pharmacy coupon [url=http://pharmworld.store/#]online pharmacy[/url] online pharmacy without prescription
mexico pharmacy: mexican rx online – mexican pharmacy
http://gabapentinneurontin.pro/# neurontin 10 mg
generic doxycycline [url=https://doxycyclinea.online/#]doxycycline 100mg price[/url] 200 mg doxycycline
neurontin 100 mg caps: 800mg neurontin – neurontin pills for sale
neurontin 100mg cap: neurontin oral – neurontin 100mg cap
https://amoxila.pro/# amoxicillin 500 mg tablets
where can i buy neurontin from canada [url=https://gabapentinneurontin.pro/#]neurontin 100 mg caps[/url] brand neurontin 100 mg canada
buy amoxicillin from canada: amoxicillin 500mg capsule cost – amoxicillin 500 mg cost
prednisone 20 mg generic: buy prednisone nz – buy prednisone online without a prescription
neurontin 600 mg cost: buy neurontin online uk – neurontin 100 mg cost
doxycycline medication: buy doxycycline – doxycycline generic
prednisone buy no prescription: prednisone 20mg online without prescription – prednisone price south africa
https://zithromaxa.store/# zithromax 600 mg tablets
buy zithromax 500mg online: zithromax 500 mg – buy zithromax 500mg online