# I've Recently Learned About GPT3 - This is my Journey

I've been very excited since GPT-3 release almost a year ago.

> TL;DR: Some thought on GTP-3 Hype

I applied early for closed beta, but had no news so far.

The product is nowadays controlled by Microsoft, and they are gatekeeping it to avoid unethical uses (and avoid [past mistakes](https://en.wikipedia.org/wiki/Tay_(bot)).

I've read some very interesting articles related to GPT-3:

%[https://hashnode.com/search?q=gpt-3]

%[https://anujsyal.com/gpt-3-the-latest-language-model-in-ai-c8634a314911]

... and made some theoretical courses on it 

%[https://www.linkedin.com/learning/introduction-to-gpt-3-a-leap-in-artificial-intelligence/gpt-3-the-next-leap-in-ai]

By now, GPT-3 is closer to [narrow artificial intelligence](https://en.wikipedia.org/wiki/Weak_AI) than [Artificial General intelligence](https://en.wikipedia.org/wiki/Artificial_general_intelligence). But it is a very successful narrow transformer deceiving humans for long time periods.

%[https://codereek.hashnode.dev/gpt-3-a-new-step-towards-general-artificial-intelligence]

# State of the art

There are not many GPT-3 Implementations due to being on closed beta. 

There's an incipient app marketplace

%[https://gpt3demo.com/]

Hopefully it will grow soon.

# Moving forward

I've been thinking a lot about transformers and generators applied to programming.

Most code generators I've tested are too dumb. They can program very basic routines and are not yet able to create [great software designs](https://maximilianocontieri.com/what-is-wrong-with-software).

%[https://www.youtube.com/watch?v=fZSFNUT6iY8]

In my Code Smell Series, I suggest detection techniques and correction measures. 

%[https://maximilianocontieri.com/series/code-smells]

Some of them involve just syntactic manipulations most actual linters can do.

But, many of them require pattern recognition and some added intelligence. 

**I am anxious to build a GPT3 solution to assist programmers and made code reviews.**

I've not seen many solutions so far

[Code Smell Detection with Machine Learning](https://repositorio.fumec.br/xmlui/bitstream/handle/123456789/175/frederico_luiz_mes_sigc_2018.pdf?sequence=1&isAllowed=y)

What do you think? Will we be using them in the near future?

* * *

I will be updating this article as long as my research goes on

Last Article Update: 2021/04/10