I've Recently Learned About GPT3 - This is my Journey
My future project on text transformers applied to code.
I've been very excited since GPT-3 release almost a year ago.
I applied early for closed beta, but had no news so far.
The product is nowadays controlled by Microsoft, and they are gatekeeping it to avoid unethical uses (and avoid past mistakes).
I've read some very interesting articles related to GPT-3:
... and made some theoretical courses on it
State of the art
There are not many GPT-3 Implementations due to being on closed beta.
There's an incipient app marketplace
Hopefully it will grow soon.
I've been thinking a lot about transformers and generators applied to programming.
Most code generators I've tested are too dumb. They can program very basic routines and are not yet able to create great software designs.
In my Code Smell Series, I suggest detection techniques and correction measures.
Some of them involve just syntactic manipulations most actual linters can do.
But, many of them require pattern recognition and some added intelligence.
I am anxious to build a GPT3 solution to assist programmers and made code reviews.
I've not seen many solutions so far
What do you think? Will we be using them in the near future?
I will be updating this article as long as my research goes on
Last Article Update: 2021/04/10