{"id":4896,"date":"2025-02-14T07:05:07","date_gmt":"2025-02-14T06:05:07","guid":{"rendered":"https:\/\/rock-the-prototype.com\/unkategorisiert\/artificial-intelligence-how-does-chat-gpt-work\/"},"modified":"2024-04-12T09:18:22","modified_gmt":"2024-04-12T07:18:22","slug":"artificial-intelligence-how-does-chat-gpt-work","status":"publish","type":"post","link":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/","title":{"rendered":"Artificial intelligence: How does Chat GPT work?"},"content":{"rendered":"<p><\/p><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 fusion-flex-container nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\"><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"max-width:1144px;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:0px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-text fusion-text-1\"><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_86 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Inhaltsverzeichnis<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #ffffff;color:#ffffff\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #ffffff;color:#ffffff\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#What_is_a_generative_pretrained_transformer_GPT\" >What is a generative pretrained transformer (GPT)?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Semantic_probabilities\" >Semantic probabilities<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Chat_GTP_is_considered_the_most_advanced_AI_model\" >Chat GTP is considered the most advanced AI model<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#How_does_it_all_work_How_reliable_is_the_information_generated_with_AI\" >How does it all work? How reliable is the information generated with AI?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Lets_now_take_a_look_at_the_facts_about_this_fascinating_AI_technology\" >Let&#8217;s now take a look at the facts about this fascinating AI technology:<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#How_does_GPT_work_and_why_is_this_AI_model_so_groundbreakingly_revolutionary\" >How does GPT work and why is this AI model so groundbreakingly revolutionary?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#How_is_a_GPT_model_actually_trained\" >How is a GPT model actually trained?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Cleverly_process_large_amounts_of_data_with_AI\" >Cleverly process large amounts of data with AI<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Self-attention_mechanism_positional_encoding\" >Self-attention mechanism &amp; positional encoding<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#GPT_is_like_a_curious_child\" >GPT is like a curious child<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#How_does_GPT_process_all_this_information\" >How does GPT process all this information?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Embeddings_as_a_multidimensional_representation_of_creative_AI\" >Embeddings as a multidimensional representation of creative AI<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Indispensable_the_fine-tuning_of_AI_models\" >Indispensable: the fine-tuning of AI models<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#After_the_fascination_comes_the_reflection\" >After the fascination comes the reflection<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#Your_click_our_common_path_How_your_support_shapes_our_digital_future\" >Your click, our common path: How your support shapes our digital future<\/a><\/li><\/ul><\/nav><\/div>\n<h3 id=\"ember322\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"What_is_a_generative_pretrained_transformer_GPT\"><\/span>What is a generative pretrained transformer (GPT)?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember323\" class=\"ember-view reader-content-blocks__paragraph\">Artificial intelligence. Today with a special focus on the world around Chat GPT. And so we find ourselves in the middle of the cosmos of generative pre-trained transformers, or GPT for short.<\/p>\n<p id=\"ember324\" class=\"ember-view reader-content-blocks__paragraph\">Immerse yourself with us in the fascinating world of artificial intelligence. In our latest Rock the Prototype podcast episode, we discover the secrets behind Chat GPT, a revolutionary AI model that is radically changing the way we communicate with machines.<\/p>\n\n<\/div><a class=\"fusion-modal-text-link\" data-toggle=\"modal\" data-target=\".fusion-modal.Spotify Podcasts Folge 17 - K&uuml;nstliche Intelligenz: Wie funktioniert Chat GPT? - Rock the Prototype Podcast\" href=\"#\"><iframe class=\"lazyload\" style=\"border-radius: 12px;\" src=\"data:image\/svg+xml,%3Csvg%20xmlns%3D%27http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%27%20width%3D%27100%27%20height%3D%27352%27%20viewBox%3D%270%200%20100%20352%27%3E%3Crect%20width%3D%27100%27%20height%3D%27352%27%20fill-opacity%3D%220%22%2F%3E%3C%2Fsvg%3E\" data-orig-src=\"https:\/\/open.spotify.com\/embed\/episode\/5sPPqwIHZ6kAcKTV7l0lCO?utm_source=generator\" width=\"100%\" height=\"352\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/a>\n<div class=\"fusion-text fusion-text-2\"><h3><span class=\"ez-toc-section\" id=\"Semantic_probabilities\"><\/span>Semantic probabilities<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember326\" class=\"ember-view reader-content-blocks__paragraph\">We unravel the threads of semantic probabilities and reveal how AI technology can come so incredibly close to our human understanding. Is it true intelligence or simply a reflection of our own language? Join us on an exciting journey through the neural landscape of GPT and push your boundaries between human creativity and <a href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/machine-learning\/\" target=\"_blank\" title=\"Machine learning is a branch of artificial intelligence (AI) that deals with the development of algorithms and models that enable computers to learn from experience and data, recognize patterns and make predictions without being explicitly programmed. The aim of machine learning is to enable computers to learn independently from data and extract information in order to master complex tasks. We explain which concepts are used to do this and how predictions can be made by adapting models to existing data.\" class=\"encyclopedia\">machine learning<\/a>&hellip;<\/p>\n<p>Listen now:<\/p>\n<p id=\"ember328\" class=\"ember-view reader-content-blocks__paragraph\">&#127911; Listen on Spotify: &#128073; <a class=\"app-aware-link \" href=\"https:\/\/bit.ly\/3VSgxK4\" target=\"_self\" rel=\"noopener\" data-test-app-aware-link=\"\">https:\/\/bit.ly\/3VSgxK4<\/a><\/p>\n<p id=\"ember329\" class=\"ember-view reader-content-blocks__paragraph\"><a class=\"app-aware-link \" href=\"https:\/\/bit.ly\/3VSgxK4%F0%9F%8D%8E\" target=\"_self\" rel=\"noopener\" data-test-app-aware-link=\"\">&#127822;<\/a> Enjoy on Apple Podcasts: &#128073; <a class=\"app-aware-link \" href=\"https:\/\/apple.co\/43SaEyk\" target=\"_self\" rel=\"noopener\" data-test-app-aware-link=\"\">https:\/\/apple.co\/43SaEyk<\/a><\/p>\n<p id=\"ember330\" class=\"ember-view reader-content-blocks__paragraph\">While we have all heard of AI in various contexts or even interacted with it ourselves, behind the scenes is a fascinating technology that is completely revolutionizing the way we work, learn and even communicate.<\/p>\n<\/div><div class=\"fusion-text fusion-text-3\"><h3 id=\"ember331\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"Chat_GTP_is_considered_the_most_advanced_AI_model\"><\/span>Chat GTP is considered the most advanced AI model<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember332\" class=\"ember-view reader-content-blocks__paragraph\">That&rsquo;s why today we&rsquo;re focusing on the very technology that has helped AI make a decisive breakthrough in the public eye. We are of course talking about GPT, an advanced AI model developed by OpenAI.<\/p>\n<p id=\"ember333\" class=\"ember-view reader-content-blocks__paragraph\">In this article &ndash; or you can just listen to my podcast &ndash; I unravel the mystery of GPT and the AI models underlying this technology, the generative pre-trained transformers that currently significantly influence how we perceive and interact with artificial intelligence.<\/p>\n<p id=\"ember334\" class=\"ember-view reader-content-blocks__paragraph\">We dive into the history of AI and explore how AI works with its software-based models and algorithms. We reflect on the diverse applications of AI and look at the associated ethical challenges as well as the exciting future that awaits us with these AI technologies.<\/p>\n<p id=\"ember335\" class=\"ember-view reader-content-blocks__paragraph\"><strong>What exactly is GPT? <\/strong><\/p>\n<p id=\"ember336\" class=\"ember-view reader-content-blocks__paragraph\">In short, it&rsquo;s an impressively powerful AI that is trained to understand, generate and even respond to text in a way that is often almost indistinguishable from human interaction.<\/p>\n<\/div><a class=\"fusion-modal-text-link\" data-toggle=\"modal\" data-target=\".fusion-modal.Apple Podcasts Folge 17 - K&uuml;nstliche Intelligenz: Wie funktioniert Chat GPT? - Rock the Prototype Podcast\" href=\"#\"><iframe style=\"width: 100%; max-width: 660px; overflow: hidden; border-radius: 10px;\" src=\"https:\/\/embed.podcasts.apple.com\/us\/podcast\/folge-17-k%C3%BCnstliche-intelligenz-wie-funktioniert-chat-gpt\/id1684107786?i=1000651978075\" height=\"175\" frameborder=\"0\" sandbox=\"allow-forms allow-popups allow-same-origin allow-scripts allow-storage-access-by-user-activation allow-top-navigation-by-user-activation\"><\/iframe><\/a>\n<div class=\"fusion-text fusion-text-4\"><p id=\"ember337\" class=\"ember-view reader-content-blocks__paragraph\">GPT models have already fundamentally changed the rules of the game. From simple to complex answers to the most diverse questions in all conceivable subject categories. From ideas to writing entire articles and even <a href=\"https:\/\/rock-the-prototype.com\/en\/learn-programming\/programming\/\" target=\"_blank\" title=\"What is programming? When programming, a programmer creates a software program that can run on a machine. The code is created in one of the formally defined computer languages - which are countless, such as Java, PHP, C++ or C#, Perl and many many more.\" class=\"encyclopedia\">programming<\/a>, these AI models are now proficient.<\/p>\n<h3 id=\"ember338\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"How_does_it_all_work_How_reliable_is_the_information_generated_with_AI\"><\/span>How does it all work? How reliable is the information generated with AI?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember339\" class=\"ember-view reader-content-blocks__paragraph\">But how does it all work? And how reliable is the information generated with AI?<\/p>\n<p id=\"ember340\" class=\"ember-view reader-content-blocks__paragraph\">Although this may sound like pure science fiction to some, it is reality &ndash; a reality that becomes more and more sophisticated with every GPT update. But why should we bother with it at all? Well, the answer is simple: GPT and similar AI technologies are shaping our future.<\/p>\n<p id=\"ember341\" class=\"ember-view reader-content-blocks__paragraph\">Exactly. The way we search for information, how we learn and how we interact with machines is changing radically.<\/p>\n<p id=\"ember342\" class=\"ember-view reader-content-blocks__paragraph\">GPT is not only a window into a new era of AI-driven communication and creativity, it is also a tool that has the potential to redefine education, the corporate world, programming and even artistic expression.<\/p>\n<p id=\"ember343\" class=\"ember-view reader-content-blocks__paragraph\">And that is exactly why understanding GPT is so crucial. Not just for technology enthusiasts or developers, but for everyone. The way we think about problem solving, innovation and even the limits of human creativity is at stake.<\/p>\n<h3 id=\"ember344\" class=\"ember-view\">Let&rsquo;s now take a look at the facts about this fascinating AI technology:<\/h3>\n<p id=\"ember345\" class=\"ember-view reader-content-blocks__paragraph\">Developed by the US AI specialist OpenAI, GPT has become a successful model in the world of artificial intelligence. But what is GPT? What does the acronym stand for?<\/p>\n<p id=\"ember346\" class=\"ember-view reader-content-blocks__paragraph\">GPT stands for<strong>&ldquo;Generative Pre-trained Transformer<\/strong>&ldquo;. Let&rsquo;s break it down piece by piece and translate it into German to better understand what&rsquo;s behind this abbreviation.<\/p>\n<p id=\"ember347\" class=\"ember-view reader-content-blocks__paragraph\"><strong>&ldquo;Generative<\/strong>&rdquo; means producing or generating. In the AI world, we talk about generative models when it comes to creating content. These can be texts, images or even music. The special thing about GPT is its ability to generate texts that are so convincing that they are almost indistinguishable from those written by humans.<\/p>\n<p id=\"ember348\" class=\"ember-view reader-content-blocks__paragraph\"><strong>&ldquo;Pre-trained<\/strong>&rdquo; &ndash; that means pre-trained. Before GPT is entrusted with specific tasks, it undergoes an extensive learning phase. In this phase, it is fed with huge amounts of text data to gain a basic understanding of the language. This pre-training is crucial so that an AI model can later respond efficiently to more specific requests.<\/p>\n<p id=\"ember349\" class=\"ember-view reader-content-blocks__paragraph\">And finally &ldquo;Transformer&rdquo; &ndash; the part of the name that refers to the revolutionary AI architecture on which GPT is based. The Transformer architecture allows the model to understand the meaning of words in the context of other words, rather than looking at them in isolation. This is a key aspect that characterizes GPT&rsquo;s impressive ability to generate coherent and nuanced texts.<\/p>\n<\/div><div class=\"fusion-text fusion-text-5\"><p id=\"ember350\" class=\"ember-view reader-content-blocks__paragraph\">GPT is a generative, pre-trained AI model based on the Transformer architecture. Chat GPT is a prime example of how far artificial intelligence has come in recent years.<\/p>\n<p>Now that we know what&rsquo;s behind the acronym GPT, let&rsquo;s dive deeper into the mechanisms of this AI technology that make it so powerful.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"How_does_GPT_work_and_why_is_this_AI_model_so_groundbreakingly_revolutionary\"><\/span>How does GPT work and why is this AI model so groundbreakingly revolutionary?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember353\" class=\"ember-view reader-content-blocks__paragraph\">GPT is based on the Transformer architecture, an innovation that entered the artificial intelligence stage in 2017 and has been here to stay ever since. This AI technology uses huge amounts of data, learns from it and allows us to communicate with machines in a way that was previously science fiction.<\/p>\n<p>Now we explore how a GPT model is trained and how it acquires its impressively generative, i.e. almost creative and so amazingly natural-looking abilities.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"How_is_a_GPT_model_actually_trained\"><\/span>How is a GPT model actually trained?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>To understand this, we must first <strong>familiarize <\/strong>ourselves with the <strong>basic principles of the Transformer architecture<\/strong>, which forms the core of GPT.<\/p>\n<p>A key element of this architecture is the so-called self-attention mechanism.<\/p>\n<p>This is a technical mechanism used by the AI, i.e. the way the AI model performs internal calculations to recognize relationships between words in a sentence.<\/p>\n<p>This clever mechanism in the AI model makes it possible to understand the meaning of each word in a sentence in the context of all the other words.<\/p>\n<p>Listen now:<\/p>\n<p id=\"ember361\" class=\"ember-view reader-content-blocks__paragraph\">&#127911; Listen on Spotify: &#128073; <a class=\"app-aware-link \" href=\"https:\/\/bit.ly\/3VSgxK4\" target=\"_self\" rel=\"noopener\" data-test-app-aware-link=\"\">https:\/\/bit.ly\/3VSgxK4<\/a><\/p>\n<p id=\"ember362\" class=\"ember-view reader-content-blocks__paragraph\"><a class=\"app-aware-link \" href=\"https:\/\/bit.ly\/3VSgxK4%F0%9F%8D%8E\" target=\"_self\" rel=\"noopener\" data-test-app-aware-link=\"\">&#127822;<\/a> Enjoy on Apple Podcasts: &#128073; <a class=\"app-aware-link \" href=\"https:\/\/apple.co\/43SaEyk\" target=\"_self\" rel=\"noopener\" data-test-app-aware-link=\"\">https:\/\/apple.co\/43SaEyk<\/a><\/p>\n<p id=\"ember363\" class=\"ember-view reader-content-blocks__paragraph\">Instead of moving sequentially from word to word, as previous AI model architectures did, the self-attention mechanism evaluates each word in the context of the entire sentence and does so simultaneously, i.e. in parallel.<\/p>\n<p class=\"ember-view reader-content-blocks__paragraph\">The AI therefore focuses its own attention on the meaning in the overall context. Looking at something in context is something I personally love!<\/p>\n<p class=\"ember-view reader-content-blocks__paragraph\">This procedure, which computers master perfectly with their parallel approach, is often difficult for us humans.<\/p>\n<\/div><div class=\"fusion-text fusion-text-6\"><p id=\"ember366\" class=\"ember-view reader-content-blocks__paragraph\">Computers and especially models like GPT use parallel processing to analyze large amounts of data simultaneously. This ability leads to more efficient and faster processing of information.<\/p>\n<p id=\"ember367\" class=\"ember-view reader-content-blocks__paragraph\">There is no need to underestimate our cognitive abilities, after all, we humans invented this parallel data processing of computers in order to use it specifically for effective and meaningful AI assistance systems.<\/p>\n<p id=\"ember368\" class=\"ember-view reader-content-blocks__paragraph\">At this point, we can state that the development of AI models also uses a targeted prototypical approach to develop and improve effective AI models.<\/p>\n<h3 id=\"ember369\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"Cleverly_process_large_amounts_of_data_with_AI\"><\/span>Cleverly process large amounts of data with AI<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember370\" class=\"ember-view reader-content-blocks__paragraph\">This AI technology therefore enables large volumes of data to be processed more efficiently.<\/p>\n<p id=\"ember371\" class=\"ember-view reader-content-blocks__paragraph\">Imagine you are reading a sentence and can simultaneously grasp the meaning of each word in the context of all the other words. This is exactly what this mechanism enables GPT to do.<\/p>\n<p id=\"ember372\" class=\"ember-view reader-content-blocks__paragraph\">Let&rsquo;s take the sentence: &ldquo;The doctor gave the patient a medicine because he was ill.&rdquo; A person intuitively understands that &ldquo;he&rdquo; refers to &ldquo;the patient&rdquo;. GPT can track this through the self-attention mechanism by recognizing the relationship between widely spaced words and weighting the meaning of each word in relation to every other word in the text.<\/p>\n<p id=\"ember373\" class=\"ember-view reader-content-blocks__paragraph\">But how does GPT take into account the order of the words if the self-attention mechanism does not process the input words in any particular order? This is where positional encoding comes into play. It adds additional information to each word about its position in the sentence, which allows the model to recognize the position of each word and understand the grammatical structure of the text.<\/p>\n<h3 id=\"ember374\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"Self-attention_mechanism_positional_encoding\"><\/span>Self-attention mechanism &amp; positional encoding<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember375\" class=\"ember-view reader-content-blocks__paragraph\">But how does GPT take into account the order of the words if the self-attention mechanism does not process the input words in any particular order? This is where positional encoding comes into play. It adds additional information to each word about its position in the sentence, which allows the model to recognize the position of each word and understand the grammatical structure of the text.<\/p>\n<p id=\"ember376\" class=\"ember-view reader-content-blocks__paragraph\">Let us briefly illustrate the revolutionary difference between this AI technology and traditional AI models:<\/p>\n<p id=\"ember377\" class=\"ember-view reader-content-blocks__paragraph\">In the past, many approaches in artificial intelligence, especially in the field of natural language processing, were based on tree structures and concepts from graph theory. These methods attempted to depict the complex structure of language using hierarchical models that represent the relationships between words and phrases in a kind of tree diagram.<\/p>\n<p id=\"ember378\" class=\"ember-view reader-content-blocks__paragraph\">However, GPT and the entire Transformer architecture take a different path.<\/p>\n<p id=\"ember379\" class=\"ember-view reader-content-blocks__paragraph\">Instead of relying on predefined structures, they use the self-attention mechanism and positional encoding to directly capture the meaning and relationships of words within a sentence &ndash; without the need to organize these relationships into rigid tree structures. This approach allows for a more flexible and often more accurate interpretation of text, as it can take into account the direct and indirect relationships between all the words in a text.<\/p>\n<div id=\"attachment_4891\" style=\"width: 1466px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" aria-describedby=\"caption-attachment-4891\" class=\"size-full wp-image-4890\" src=\"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype.jpg\" alt=\"How do generative pretrained transformers (GPT) work? - Source: midjourney\" width=\"1456\" height=\"816\" srcset=\"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-200x112.jpg 200w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-300x168.jpg 300w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-400x224.jpg 400w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-600x336.jpg 600w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-768x430.jpg 768w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-800x448.jpg 800w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-1024x574.jpg 1024w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype-1200x673.jpg 1200w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktionieren-generative-pretrained-Transformer-gpt_rock_the_prototype.jpg 1456w\" sizes=\"(max-width: 1456px) 100vw, 1456px\"><p id=\"caption-attachment-4891\" class=\"wp-caption-text\">How do generative pretrained transformers (GPT) work? &ndash; Source: midjourney<\/p><\/div>\n<\/div><div class=\"fusion-text fusion-text-7\"><p id=\"ember381\" class=\"ember-view reader-content-blocks__paragraph\">This innovation has fundamentally changed the way machines understand and generate text. While traditional models attempt to decode language using fixed rules and structures, GPT allows AI to develop a more intuitive and comprehensive understanding of texts. It is as if we have made the leap from rigid, predefined paths to an open field full of possibilities where the AI can navigate and learn freely.<\/p>\n<p id=\"ember382\" class=\"ember-view reader-content-blocks__paragraph\">This paradigm shift is a very important point that you can take away from my article here as a key moment in the development of artificial intelligence.<\/p>\n<p id=\"ember383\" class=\"ember-view reader-content-blocks__paragraph\">It shows how far we&rsquo;ve come and opens the door to new, exciting ways in which AI can understand and interact with our world.<\/p>\n<p id=\"ember384\" class=\"ember-view reader-content-blocks__paragraph\">By combining self-attention and positional encoding, GPT can thus generate and interpret impressive texts that demonstrate a deep understanding of both context and grammatical structure. The result? A performance that often appears astonishingly human-like.<\/p>\n<p id=\"ember385\" class=\"ember-view reader-content-blocks__paragraph\">But this is just the beginning. Stay tuned, because next we&rsquo;ll dive deeper into GPT&rsquo;s training process and discover how unsupervised learning and the ability to predict words based on their context make GPT one of the most advanced AI models today.<\/p>\n<p id=\"ember386\" class=\"ember-view reader-content-blocks__paragraph\">Having already highlighted the revolutionary technology behind GPT and how it differs from traditional AI models, we turn to another fascinating aspect: the pre-training process. How exactly does GPT learn to generate human-like texts? The answer lies in unsupervised learning, a process that allows GPT to be trained without explicitly labeled data.<\/p>\n<h3 id=\"ember387\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"GPT_is_like_a_curious_child\"><\/span>GPT is like a curious child<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember388\" class=\"ember-view reader-content-blocks__paragraph\">Let&rsquo;s imagine that GPT is a curious child living in a huge <a href=\"https:\/\/rock-the-prototype.com\/en\/learn-programming\/library\/\" target=\"_blank\" title=\"A library refers to a software library as a ready-made collection of code that can be used to perform general software development tasks. Libraries are essentially a collection of functions and procedures that can be called up by other software programs to execute certain functions.\" class=\"encyclopedia\">library<\/a> full of books, articles and websites. Instead of telling him what each word means, you just let him read it. By reading, GPT tries to understand the structure of the language, its patterns and the meaning of the words in context. For example, it learns to anticipate the next word in a sentence or to complete missing parts of a text. In this way, GPT develops an intuitive feeling for language, similar to a person who learns by listening and reading.<\/p>\n<h3 id=\"ember389\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"How_does_GPT_process_all_this_information\"><\/span>How does GPT process all this information?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember390\" class=\"ember-view reader-content-blocks__paragraph\">The first step is tokenization.<\/p>\n<p id=\"ember391\" class=\"ember-view reader-content-blocks__paragraph\">Generative AI models such as GPT divide text data into units called <em>tokens<\/em>for processing.<\/p>\n<p id=\"ember392\" class=\"ember-view reader-content-blocks__paragraph\">The conversion of text data into tokens depends on the tokenizer used. A token can be characters, words or groups of words. Each AI model has a maximum number of tokens that it can process in one prompt and one response.<\/p>\n<p id=\"ember393\" class=\"ember-view reader-content-blocks__paragraph\">GPT therefore breaks down each text into smaller units, the so-called tokens. Then the embeddings come into play.<\/p>\n<p id=\"ember394\" class=\"ember-view reader-content-blocks__paragraph\">Each token is converted into a vector that maps the diverse semantic and syntactic information of the token in a high-dimensional space.<\/p>\n<h3 id=\"ember395\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"Embeddings_as_a_multidimensional_representation_of_creative_AI\"><\/span>Embeddings as a multidimensional representation of creative AI<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember396\" class=\"ember-view reader-content-blocks__paragraph\">These vectors, or embeddings, serve as a kind of multidimensional representation of the tokens, enabling the AI model to recognize and process subtle differences in meaning and relationships between different words.<\/p>\n<p id=\"ember397\" class=\"ember-view reader-content-blocks__paragraph\">In essence, embeddings capture the essence of words in a way that goes beyond the traditional binary representation of text. They enable GPT to understand patterns, contexts and the nuances of human language at a deeper level, which forms the basis of its ability to generate coherent and contextually relevant texts.<\/p>\n<p id=\"ember398\" class=\"ember-view reader-content-blocks__paragraph\">These vectors or embeddings are therefore at the heart of GPT&rsquo;s learning process. They enable the AI model to understand the meaning of the words and their relationships to each other.<\/p>\n<p id=\"ember399\" class=\"ember-view reader-content-blocks__paragraph\">During the pre-training process, this network of vectors is continuously refined and optimized.<\/p>\n<p id=\"ember400\" class=\"ember-view reader-content-blocks__paragraph\">The goal?<\/p>\n<p id=\"ember401\" class=\"ember-view reader-content-blocks__paragraph\">That GPT learns to represent similar words by similar vectors, developing a deep understanding of language and its nuances.<\/p>\n<p id=\"ember402\" class=\"ember-view reader-content-blocks__paragraph\">This process of reading, learning and understanding forms the basis for GPT&rsquo;s ability to generate texts that are almost indistinguishable from human ones.<\/p>\n<\/div><div class=\"fusion-text fusion-text-8\"><p id=\"ember403\" class=\"ember-view reader-content-blocks__paragraph\">It is a clever AI process that seems simple in its basic idea &ndash; to break down text into tokens and convert them into multidimensional vectors.<\/p>\n<p id=\"ember404\" class=\"ember-view reader-content-blocks__paragraph\">However, the actual implementation is extremely complex. Each token is placed in a space of countless dimensions, with subtle semantic nuances and syntactic relationships encoded in vector form.<\/p>\n<p id=\"ember405\" class=\"ember-view reader-content-blocks__paragraph\">This highly detailed and nuanced processing of speech requires immense computing power. This is because the training and application of models such as GPT requires billions of parameters to be updated and optimized in real time, which would not be feasible without advanced hardware and specialized AI algorithms.<\/p>\n<p id=\"ember406\" class=\"ember-view reader-content-blocks__paragraph\">This need for enormous computing capacity underlines the technological masterpiece behind GPT and similar AI systems.<\/p>\n<p id=\"ember407\" class=\"ember-view reader-content-blocks__paragraph\">All of this impressively illustrates what modern artificial intelligence is capable of and underlines its impressive capacity to not only recognize complex speech patterns, but to process and generate them in a way that was unimaginable until recently.<\/p>\n<h3 id=\"ember408\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"Indispensable_the_fine-tuning_of_AI_models\"><\/span>Indispensable: the fine-tuning of AI models<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember409\" class=\"ember-view reader-content-blocks__paragraph\">Now that we know how GPT acquires a broad base of language knowledge through the process of unsupervised learning, let&rsquo;s dive deeper into the next crucial step: fine-tuning. This phase is crucial to transform GPT from a general language model into a highly specialized tool tailored to specific needs.<\/p>\n<p id=\"ember410\" class=\"ember-view reader-content-blocks__paragraph\">Imagine GPT is like a versatile artist who is able to paint in many different styles. However, in order to create a masterpiece in a particular style, this artist must further refine and specialize his knowledge and skills. This is exactly what happens when GPT is fine-tuned. The model, which already has a comprehensive understanding of the language, is now trained with a more specific data set that is precisely tailored to the desired task.<\/p>\n<p id=\"ember411\" class=\"ember-view reader-content-blocks__paragraph\">Let&rsquo;s take the creation of legal documents as an example. Having already been trained on a wide range of texts, GPT undergoes an additional training phase with a dataset of legal texts. In this phase, the AI model learns the subtleties of legal language, its style and structure.<\/p>\n<p id=\"ember412\" class=\"ember-view reader-content-blocks__paragraph\">The result? GPT is now able to generate legal documents that are not only correct in terms of content, but also comply with the specific conventions and requirements of legal writing. This ability to fine-tune gives GPT impressive flexibility and makes it an indispensable tool for professionals in a wide range of fields.<\/p>\n<p id=\"ember413\" class=\"ember-view reader-content-blocks__paragraph\">Fine-tuning thus transforms GPT from a powerful general AI language model into a customized tool that is precisely tailored to the requirements of a specific task or field. This underlines the extraordinary adaptability and versatility of modern artificial intelligence.<\/p>\n<p id=\"ember414\" class=\"ember-view reader-content-blocks__paragraph\">What appears so intelligent to us humans in GPT-based AI is actually based on an extremely clever principle of semantic probabilities. After all, semantics is the art of giving words meaning in context.<\/p>\n<\/div><div class=\"fusion-text fusion-text-9\"><p id=\"ember415\" class=\"ember-view reader-content-blocks__paragraph\">But it is important to understand that this &ldquo;intelligence&rdquo; is not in fact the same as our human cognition or understanding language in the same way that humans do.<\/p>\n<p id=\"ember416\" class=\"ember-view reader-content-blocks__paragraph\">Rather, it is a highly developed form of pattern recognition and prediction. GPT cannot really grasp the sense or meaning behind the words. Instead, the AI simulates understanding by predicting which words or phrases appear to make the most sense in a given context based on statistical patterns and probabilities from its training text.<\/p>\n<h3 id=\"ember417\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"After_the_fascination_comes_the_reflection\"><\/span>After the fascination comes the reflection<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember418\" class=\"ember-view reader-content-blocks__paragraph\">As we explore the impressive capabilities of AI models such as GPT and similar AI technologies, we must not forget that we too continue to face challenges through the use of artificial intelligence.<\/p>\n<p id=\"ember419\" class=\"ember-view reader-content-blocks__paragraph\">One of the most significant is the context limitation &ndash; i.e. how much of the text GPT can retain and use for its current calculations.<\/p>\n<p id=\"ember420\" class=\"ember-view reader-content-blocks__paragraph\">Earlier versions of GPT were significantly limited in this respect, which made it difficult to create long and coherent texts.<\/p>\n<p id=\"ember421\" class=\"ember-view reader-content-blocks__paragraph\">Fortunately, progress has been made. Technical improvements and more efficient training methods have increased the maximum context length in newer versions of GPT.<\/p>\n<p id=\"ember422\" class=\"ember-view reader-content-blocks__paragraph\">GPT-4 has made enormous progress in this respect. The context length was extended to over 131,072 tokens.<\/p>\n<p id=\"ember423\" class=\"ember-view reader-content-blocks__paragraph\">GPT uses an extended character set that includes Unicode characters encoded in UTF-8 so that it can support a wide range of languages and special symbols, enabling the generation and interpretation of text in a variety of human languages, including those with non-Latin writing systems.<\/p>\n<p id=\"ember424\" class=\"ember-view reader-content-blocks__paragraph\">Based on the assumption that a token comprises an average of around 4 characters, that would be over half a million characters that GPT can process in a context of 131,072 tokens.<\/p>\n<p id=\"ember425\" class=\"ember-view reader-content-blocks__paragraph\">Our assumption is based on the English language, in which many words are relatively short. This estimate therefore varies for different languages, but will be higher for our German language.<\/p>\n<p id=\"ember426\" class=\"ember-view reader-content-blocks__paragraph\">This assumption helps us to get a rough idea of how much text &ndash; in characters &ndash; the AI model can process or &ldquo;understand&rdquo; in a given context.<\/p>\n<p id=\"ember427\" class=\"ember-view reader-content-blocks__paragraph\">Since tokens can vary in length &ndash; some could be only one character long &ndash; like a punctuation mark or a single letter &ndash; while others could be multiple characters long (like a whole word or a compound phrase) &ndash; assuming an average of 4 characters per token serves as a middle ground to estimate the overall capacity of the model to process text. You can find the scientific report from Open AI <a href=\"https:\/\/arxiv.org\/pdf\/2303.08774.pdf\" target=\"_blank\" rel=\"noopener\">here<\/a>.<\/p>\n<p id=\"ember428\" class=\"ember-view reader-content-blocks__paragraph\">But despite these improvements, we have to realize that AI models still have to deal with distortions, so-called hallucinations. The AI invents facts here and thus sometimes misleads users.<\/p>\n<p id=\"ember429\" class=\"ember-view reader-content-blocks__paragraph\">So-called adversarial prompts also tempt the AI to give unwanted answers.<\/p>\n<p id=\"ember430\" class=\"ember-view reader-content-blocks__paragraph\">These are basically specifically formulated queries or inputs that aim to trick the AI or trick it into giving answers that are inaccurate, inappropriate or even against its programmed guidelines.<\/p>\n<p id=\"ember431\" class=\"ember-view reader-content-blocks__paragraph\">It is therefore also crucial to responsibly test the limits of AI and its capabilities, understand intentions and respond appropriately.<\/p>\n<p id=\"ember432\" class=\"ember-view reader-content-blocks__paragraph\">Such targeted testing highlights the need for continuous improvement in a way that allows us to understand AI models accurately and ensure their responses remain within ethical and regulatory guardrails.<\/p>\n<p id=\"ember433\" class=\"ember-view reader-content-blocks__paragraph\">This dynamic interaction between AI and our human communication shows how important it is to understand our models not only in terms of their ability to process information, but also requires ethical and legal guidelines tailored to them.<\/p>\n<p id=\"ember434\" class=\"ember-view reader-content-blocks__paragraph\">The journey of artificial intelligence is far from over. With every step we take forward, new doors and fascinating opportunities open up, but they also come with responsibilities.<\/p>\n<p id=\"ember435\" class=\"ember-view reader-content-blocks__paragraph\">How we shape and use this technology will help shape the future of our society.<\/p>\n<h3 id=\"ember436\" class=\"ember-view\"><span class=\"ez-toc-section\" id=\"Your_click_our_common_path_How_your_support_shapes_our_digital_future\"><\/span>Your click, our common path: How your support shapes our digital future<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p id=\"ember437\" class=\"ember-view reader-content-blocks__paragraph\">Stay tuned, my <strong>Rock the Prototype<\/strong> format provides you with free <strong>valuable knowledge<\/strong> on crucial <strong>tech topics<\/strong> in <strong>software development and<\/strong>their social impact.<\/p>\n<p id=\"ember438\" class=\"ember-view reader-content-blocks__paragraph\"><strong>Please support me<\/strong> by <strong>subscribing to<\/strong> my <strong>newsletter<\/strong>, <strong>podcast<\/strong> &amp; <strong>YouTube<\/strong> <strong>channel<\/strong>. Of course, I also appreciate <strong>your<\/strong> <strong>feedback<\/strong>, <strong>comments<\/strong> and <strong>likes<\/strong>!<\/p>\n<\/div><div class=\"fusion-text fusion-text-10\"><p>Subscribe to my <strong>Linkedin Newsletter<\/strong> now: &#128073; <a class=\"app-aware-link \" href=\"https:\/\/lnkd.in\/exv82i4M\" target=\"_self\" rel=\"noopener\" data-test-app-aware-link=\"\">https:\/\/lnkd.in\/exv82i4M<\/a> &#128072; Compact information &ndash; easy to understand!<\/p>\n<p>Until then, stay safe, creative and above all curious!<\/p>\n<p>Your Sascha Block<\/p>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-2 fusion-flex-container has-pattern-background has-mask-background nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\"><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"max-width:1144px;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-1 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:0px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><a class=\"fusion-modal-text-link\" data-toggle=\"modal\" data-target=\".fusion-modal.Rock the Prototype - Software development &amp; Prototyping Podcast iTunes\" href=\"#\"><iframe id=\"embedPlayer\" style=\"width: 100%; max-width: 660px; overflow: hidden; border-radius: 10px; transform: translateZ(0px); animation: 2s ease 0s 6 normal none running loading-indicator; background-color: #e4e4e4;\" src=\"https:\/\/embed.podcasts.apple.com\/us\/podcast\/rock-the-prototype-software-development-prototyping\/id1684835330?itsct=podcast_box_player&amp;itscg=30200&amp;ls=1&amp;theme=auto\" height=\"450px\" frameborder=\"0\" sandbox=\"allow-forms allow-popups allow-same-origin allow-scripts allow-top-navigation-by-user-activation\"><\/iframe><\/a><\/div><\/div><\/div><\/div>\n<div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-3 fusion-flex-container has-pattern-background has-mask-background nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\"><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"max-width:1144px;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-2 fusion_builder_column_1_3 1_3 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:33.333333333333%;--awb-margin-top-large:0px;--awb-spacing-right-large:5.76%;--awb-margin-bottom-large:0px;--awb-spacing-left-large:5.76%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-title title fusion-title-1 fusion-sep-none fusion-title-text fusion-title-size-two\" style=\"--awb-margin-top-small:30px;--awb-margin-right-small:0px;--awb-margin-bottom-small:20px;--awb-margin-left-small:0px;\"><h2 class=\"fusion-title-heading title-heading-left fusion-responsive-typography-calculated\" style=\"margin:0;--fontSize:30;line-height:1.1;\">About the Author:<\/h2><\/div><div class=\"fusion-image-element\" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-1 hover-type-none\"><img decoding=\"async\" width=\"1920\" height=\"1920\" title=\"Sascha Block &ndash; Rock the Prototype\" src=\"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2019\/09\/Sascha_Block.jpg\" alt class=\"img-responsive wp-image-3342\" srcset=\"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2019\/09\/Sascha_Block-200x200.jpg 200w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2019\/09\/Sascha_Block-400x400.jpg 400w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2019\/09\/Sascha_Block-600x600.jpg 600w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2019\/09\/Sascha_Block-800x800.jpg 800w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2019\/09\/Sascha_Block-1200x1200.jpg 1200w, https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2019\/09\/Sascha_Block.jpg 1920w\" sizes=\"(max-width: 1024px) 100vw, (max-width: 640px) 100vw, 400px\"><\/span><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-3 fusion_builder_column_2_3 2_3 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:66.666666666667%;--awb-margin-top-large:0px;--awb-spacing-right-large:2.88%;--awb-margin-bottom-large:0px;--awb-spacing-left-large:2.88%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-title title fusion-title-2 fusion-sep-none fusion-title-text fusion-title-size-three\" style=\"--awb-margin-top-small:30px;--awb-margin-right-small:0px;--awb-margin-bottom-small:20px;--awb-margin-left-small:0px;\"><h3 class=\"fusion-title-heading title-heading-left fusion-responsive-typography-calculated\" style=\"margin:0;--fontSize:26;line-height:1.2;\">Sascha Block<\/h3><\/div><div class=\"fusion-text fusion-text-11\"><p>I am <a href=\"https:\/\/www.linkedin.com\/in\/sascha-block-5785b9126\/\">Sascha Block<\/a> &ndash; IT architect in Hamburg and the initiator of Rock the Prototype. I want to make <a href=\"https:\/\/rock-the-prototype.com\/en\/prototyping-en\/prototyping\/\" target=\"_blank\" title=\"What is prototyping? Prototyping is both a process and a strategy for realizing ideas as quickly as possible.\" class=\"encyclopedia\">prototyping<\/a> learnable and experiential. With the motivation to prototype ideas and share knowledge around software prototyping, software architecture and programming, I created the format and the open source initiative Rock the Prototype.<\/p>\n<\/div><div><a class=\"fusion-button button-flat fusion-button-default-size button-default fusion-button-default button-1 fusion-button-default-span fusion-button-default-type\" target=\"_blank\" rel=\"noopener noreferrer\" href=\"https:\/\/rock-the-prototype.com\/programmieren-lernen\/strategien-zur-code-optimierung-und-algorithmen-effizienz-beispiele-best-practices\/\"><span class=\"fusion-button-text awb-button__text awb-button__text--default\">Strategies for code optimization and algorithm efficiency: examples &amp; best practices<\/span><\/a><\/div><div class=\"fusion-separator fusion-full-width-sep\" style=\"align-self: center;margin-left: auto;margin-right: auto;width:100%;\"><\/div><ul style=\"--awb-line-height:23.8px;--awb-icon-width:23.8px;--awb-icon-height:23.8px;--awb-icon-margin:9.8px;--awb-content-margin:33.6px;--awb-circlecolor:var(--awb-color3);--awb-circle-yes-font-size:12.32px;\" class=\"fusion-checklist fusion-checklist-1 fusion-checklist-default type-icons\"><li class=\"fusion-li-item\" style=\"\"><span class=\"icon-wrapper circle-yes\"><i class=\"fusion-li-icon fa-link fas\" aria-hidden=\"true\"><\/i><\/span><div class=\"fusion-li-item-content\">\n<p><a href=\"https:\/\/rock-the-prototype.com\/en\/\">rock-the-prototype.com<\/a><\/p>\n<\/div><\/li><\/ul><\/div><\/div><\/div><\/div>\n\n","protected":false},"excerpt":{"rendered":"<p>Artificial intelligence: How does Chat GPT work? I unravel the threads of semantic probabilities and reveal how AI technology can come so incredibly close to our human understanding. Join me on an exciting journey through the neural landscape of GPT and expand your boundaries between human creativity and machine learning&#8230; &#x2705; What exactly is GPT? &#x2705; How does a Generative Pretrained Transformer (GPT) work? &#x2705; Chat GPT &#8211; facts about this fascinating AI technology &#x2705; How does GPT work and why is this AI model so groundbreakingly revolutionary?<br \/>\n&#x2705; How is a GPT model actually trained? &#x2705; The revolutionary difference between GPT AI technology and traditional AI models &#x2705; The power of combining self-attention and positional encoding &#x2705; Pre-training &#8211; the pre-training process of AI &#x2705; How does GPT process all this information? &#x2705; The embeddings strategy of the AI model  <\/p>\n","protected":false},"author":1,"featured_media":4894,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[1870],"tags":[2455,2727,2757,1808,2747,1927,2752,2746,2745,2744,2749,2719,2715,2755,2705,2756,2748,1806,2708,1832,1990,2754,2751,1170,2753,1148,2750],"class_list":["post-4896","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence-ai","tag-ai","tag-ai-en","tag-ai-models","tag-artificial-intelligence","tag-artificial-intelligence-en","tag-big-data-en","tag-bigdata-en","tag-chat-gpt-en","tag-chatgpt-en","tag-data-science-en","tag-deeplearning-en","tag-distortions","tag-embeddings-en","tag-finetuning-en","tag-gpt-en","tag-hallucinations","tag-machine-learning-en-2","tag-machine-learning","tag-neural-networks-en","tag-neural-networks","tag-nlp-en","tag-positionalencoding-en","tag-pretraining-en","tag-prototyping-en","tag-selfattention-en","tag-software-development","tag-transformer-en"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Artificial intelligence: How does Chat GPT work? - AI &amp; Software Development<\/title>\n<meta name=\"description\" content=\"AI - What is a Generative Pretrained Transformer? \u2705 What exactly is GPT? \u2705 Facts about Chat GPT \u2705 How is a GPT model actually trained?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Artificial intelligence: How does Chat GPT work? - AI &amp; Software Development\" \/>\n<meta property=\"og:description\" content=\"AI - What is a Generative Pretrained Transformer? \u2705 What exactly is GPT? \u2705 Facts about Chat GPT \u2705 How is a GPT model actually trained?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/\" \/>\n<meta property=\"og:site_name\" content=\"Rock the Prototype - Softwareentwicklung &amp; Prototyping\" \/>\n<meta property=\"article:published_time\" content=\"2025-02-14T06:05:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1456\" \/>\n\t<meta property=\"og:image:height\" content=\"816\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Sascha Block\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@rocktheprototyp\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sascha Block\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"20 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/\"},\"author\":{\"name\":\"Sascha Block\",\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/#\\\/schema\\\/person\\\/fdb2f98edec62327712c2d26d981c081\"},\"headline\":\"Artificial intelligence: How does Chat GPT work?\",\"datePublished\":\"2025-02-14T06:05:07+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/\"},\"wordCount\":4387,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/rock-the-prototype.com\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg\",\"keywords\":[\"AI\",\"AI\",\"AI models\",\"Artificial intelligence\",\"Artificial intelligence\",\"Big Data\",\"BigData\",\"Chat GPT\",\"ChatGPT\",\"Data Science\",\"DeepLearning\",\"Distortions\",\"Embeddings\",\"FineTuning\",\"GPT\",\"Hallucinations\",\"Machine learning\",\"machine learning\",\"neural networks\",\"neural networks\",\"NLP\",\"PositionalEncoding\",\"PreTraining\",\"Prototyping\",\"SelfAttention\",\"Software development\",\"Transformer\"],\"articleSection\":[\"Artificial intelligence (AI)\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/\",\"url\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/\",\"name\":\"Artificial intelligence: How does Chat GPT work? - AI & Software Development\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/rock-the-prototype.com\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg\",\"datePublished\":\"2025-02-14T06:05:07+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/#\\\/schema\\\/person\\\/fdb2f98edec62327712c2d26d981c081\"},\"description\":\"AI - What is a Generative Pretrained Transformer? \u2705 What exactly is GPT? \u2705 Facts about Chat GPT \u2705 How is a GPT model actually trained?\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#primaryimage\",\"url\":\"https:\\\/\\\/rock-the-prototype.com\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg\",\"contentUrl\":\"https:\\\/\\\/rock-the-prototype.com\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg\",\"width\":1456,\"height\":816,\"caption\":\"Ku\u0308nstliche Intelligenz - Wie funktioniert Chat GPT\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/artificial-intelligence-ai\\\/artificial-intelligence-how-does-chat-gpt-work\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Startseite\",\"item\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/rock-the-prototype\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Artificial intelligence: How does Chat GPT work?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/\",\"name\":\"Rock the Prototype - Softwareentwicklung &amp; Prototyping\",\"description\":\"Prototyping: Software Prototypen, Software entwickeln &amp; Programmieren im Team\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/#\\\/schema\\\/person\\\/fdb2f98edec62327712c2d26d981c081\",\"name\":\"Sascha Block\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/967c419542686b085600443beafb2e55ad1ef6532a0ad9b96d244cb24fd8c117?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/967c419542686b085600443beafb2e55ad1ef6532a0ad9b96d244cb24fd8c117?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/967c419542686b085600443beafb2e55ad1ef6532a0ad9b96d244cb24fd8c117?s=96&d=mm&r=g\",\"caption\":\"Sascha Block\"},\"description\":\"Ich bin Sascha Block \u2013 IT-Architekt in Hamburg und der Initiator von Rock the Prototype. Ich m\u00f6chte Prototyping erlernbar und erfahrbar machen. Mit der Motivation Ideen prototypisch zu verwirklichen und Wissen rund um Software-Prototyping, Softwarearchitektur und Softwareentwicklung zu teilen, habe ich das Format und die Open-Source Initiative Rock the Prototype geschaffen.\",\"sameAs\":[\"https:\\\/\\\/rock-the-prototype.com\",\"https:\\\/\\\/www.instagram.com\\\/rock_the_prototype\\\/\",\"https:\\\/\\\/x.com\\\/rocktheprototyp\",\"https:\\\/\\\/www.youtube.com\\\/@Rock-the-Prototype\\\/\"],\"url\":\"https:\\\/\\\/rock-the-prototype.com\\\/en\\\/author\\\/administrator-2\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Artificial intelligence: How does Chat GPT work? - AI & Software Development","description":"AI - What is a Generative Pretrained Transformer? \u2705 What exactly is GPT? \u2705 Facts about Chat GPT \u2705 How is a GPT model actually trained?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/","og_locale":"en_US","og_type":"article","og_title":"Artificial intelligence: How does Chat GPT work? - AI & Software Development","og_description":"AI - What is a Generative Pretrained Transformer? \u2705 What exactly is GPT? \u2705 Facts about Chat GPT \u2705 How is a GPT model actually trained?","og_url":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/","og_site_name":"Rock the Prototype - Softwareentwicklung &amp; Prototyping","article_published_time":"2025-02-14T06:05:07+00:00","og_image":[{"width":1456,"height":816,"url":"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg","type":"image\/jpeg"}],"author":"Sascha Block","twitter_card":"summary_large_image","twitter_creator":"@rocktheprototyp","twitter_misc":{"Written by":"Sascha Block","Est. reading time":"20 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#article","isPartOf":{"@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/"},"author":{"name":"Sascha Block","@id":"https:\/\/rock-the-prototype.com\/en\/#\/schema\/person\/fdb2f98edec62327712c2d26d981c081"},"headline":"Artificial intelligence: How does Chat GPT work?","datePublished":"2025-02-14T06:05:07+00:00","mainEntityOfPage":{"@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/"},"wordCount":4387,"commentCount":0,"image":{"@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#primaryimage"},"thumbnailUrl":"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg","keywords":["AI","AI","AI models","Artificial intelligence","Artificial intelligence","Big Data","BigData","Chat GPT","ChatGPT","Data Science","DeepLearning","Distortions","Embeddings","FineTuning","GPT","Hallucinations","Machine learning","machine learning","neural networks","neural networks","NLP","PositionalEncoding","PreTraining","Prototyping","SelfAttention","Software development","Transformer"],"articleSection":["Artificial intelligence (AI)"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/","url":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/","name":"Artificial intelligence: How does Chat GPT work? - AI & Software Development","isPartOf":{"@id":"https:\/\/rock-the-prototype.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#primaryimage"},"image":{"@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#primaryimage"},"thumbnailUrl":"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg","datePublished":"2025-02-14T06:05:07+00:00","author":{"@id":"https:\/\/rock-the-prototype.com\/en\/#\/schema\/person\/fdb2f98edec62327712c2d26d981c081"},"description":"AI - What is a Generative Pretrained Transformer? \u2705 What exactly is GPT? \u2705 Facts about Chat GPT \u2705 How is a GPT model actually trained?","breadcrumb":{"@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#primaryimage","url":"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg","contentUrl":"https:\/\/rock-the-prototype.com\/wp-content\/uploads\/2024\/04\/Kuenstliche-Intelligenz-Wie-funktioniert-Chat-GPT_rock_the_prototype.jpg","width":1456,"height":816,"caption":"Ku\u0308nstliche Intelligenz - Wie funktioniert Chat GPT"},{"@type":"BreadcrumbList","@id":"https:\/\/rock-the-prototype.com\/en\/artificial-intelligence-ai\/artificial-intelligence-how-does-chat-gpt-work\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Startseite","item":"https:\/\/rock-the-prototype.com\/en\/rock-the-prototype\/"},{"@type":"ListItem","position":2,"name":"Artificial intelligence: How does Chat GPT work?"}]},{"@type":"WebSite","@id":"https:\/\/rock-the-prototype.com\/en\/#website","url":"https:\/\/rock-the-prototype.com\/en\/","name":"Rock the Prototype - Softwareentwicklung &amp; Prototyping","description":"Prototyping: Software Prototypen, Software entwickeln &amp; Programmieren im Team","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/rock-the-prototype.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/rock-the-prototype.com\/en\/#\/schema\/person\/fdb2f98edec62327712c2d26d981c081","name":"Sascha Block","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/967c419542686b085600443beafb2e55ad1ef6532a0ad9b96d244cb24fd8c117?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/967c419542686b085600443beafb2e55ad1ef6532a0ad9b96d244cb24fd8c117?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/967c419542686b085600443beafb2e55ad1ef6532a0ad9b96d244cb24fd8c117?s=96&d=mm&r=g","caption":"Sascha Block"},"description":"Ich bin Sascha Block \u2013 IT-Architekt in Hamburg und der Initiator von Rock the Prototype. Ich m\u00f6chte Prototyping erlernbar und erfahrbar machen. Mit der Motivation Ideen prototypisch zu verwirklichen und Wissen rund um Software-Prototyping, Softwarearchitektur und Softwareentwicklung zu teilen, habe ich das Format und die Open-Source Initiative Rock the Prototype geschaffen.","sameAs":["https:\/\/rock-the-prototype.com","https:\/\/www.instagram.com\/rock_the_prototype\/","https:\/\/x.com\/rocktheprototyp","https:\/\/www.youtube.com\/@Rock-the-Prototype\/"],"url":"https:\/\/rock-the-prototype.com\/en\/author\/administrator-2\/"}]}},"_links":{"self":[{"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/posts\/4896","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/comments?post=4896"}],"version-history":[{"count":6,"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/posts\/4896\/revisions"}],"predecessor-version":[{"id":4905,"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/posts\/4896\/revisions\/4905"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/media\/4894"}],"wp:attachment":[{"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/media?parent=4896"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/categories?post=4896"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rock-the-prototype.com\/en\/wp-json\/wp\/v2\/tags?post=4896"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}