![\"Positional](\"https://miro.medium.com/v2/resize:fit:1024/1*Qk05I8r-qNA7F_BJSm_wRQ.jpeg\")
\n",
+ "\n",
+ "![\"Chain](\"https://substackcdn.com/image/fetch/$s_!NPw_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F599a636e-b0b2-4de3-84c8-3edf906bfa82_1616x882.png\"\n",)
\n",
+ " ![\"Prefix](\"https://img1.daumcdn.net/thumb/R800x0/?scode=mtistory2&fname=https%3A%2F%2Fblog.kakaocdn.net%2Fdna%2FkIRwK%2FbtsIV6C9rN4%2FAAAAAAAAAAAAAAAAAAAAADrciUfx8ZUoGIkW8C_Db9ZaOMcm-k0ncQXFC7hFapPf%2Fimg.png%3Fcredential%3DyqXZFxpELC7KVnFOS48ylbz2pIh7yKj8%26expires%3D1756652399%26allow_ip%3D%26allow_referer%3D%26signature%3DNg5gJU9nZIOMIWkn9uRUiIHHIl0%253D\"\n",)
\n",
+ " ![\"Adapter](\"https://yynnyy.cn/files/images/adpter_tuning/transformer.png\"\n",)
\n",
+ "![\"Low-rank](\"https://sebastianraschka.com/images/blog/2023/llm-finetuning-lora/pca.png\"\n",)
\n",
+ " | Epoch | \n", + "Training Loss | \n", + "Validation Loss | \n", + "
|---|---|---|
| 1 | \n", + "2.746100 | \n", + "2.545077 | \n", + "
| 2 | \n", + "2.520800 | \n", + "2.477201 | \n", + "
| 3 | \n", + "2.428900 | \n", + "2.425149 | \n", + "
| 4 | \n", + "2.360600 | \n", + "2.363835 | \n", + "
| 5 | \n", + "2.288000 | \n", + "2.317809 | \n", + "
| 6 | \n", + "2.238300 | \n", + "2.282211 | \n", + "
| 7 | \n", + "2.205400 | \n", + "2.266683 | \n", + "
| 8 | \n", + "2.183100 | \n", + "2.257880 | \n", + "
| 9 | \n", + "2.165200 | \n", + "2.248238 | \n", + "
| 10 | \n", + "2.149700 | \n", + "2.244113 | \n", + "
| 11 | \n", + "2.134700 | \n", + "2.236564 | \n", + "
| 12 | \n", + "2.125400 | \n", + "2.231455 | \n", + "
| 13 | \n", + "2.116200 | \n", + "2.226874 | \n", + "
| 14 | \n", + "2.102800 | \n", + "2.224785 | \n", + "
| 15 | \n", + "2.092600 | \n", + "2.221523 | \n", + "
| 16 | \n", + "2.083200 | \n", + "2.216574 | \n", + "
| 17 | \n", + "2.076000 | \n", + "2.215619 | \n", + "
| 18 | \n", + "2.065200 | \n", + "2.211471 | \n", + "
| 19 | \n", + "2.058800 | \n", + "2.211065 | \n", + "
| 20 | \n", + "2.048800 | \n", + "2.208387 | \n", + "
| 21 | \n", + "2.044400 | \n", + "2.205810 | \n", + "
| 22 | \n", + "2.038100 | \n", + "2.204290 | \n", + "
| 23 | \n", + "2.025900 | \n", + "2.201609 | \n", + "
| 24 | \n", + "2.025300 | \n", + "2.199615 | \n", + "
| 25 | \n", + "2.016200 | \n", + "2.198286 | \n", + "
| 26 | \n", + "2.012000 | \n", + "2.198893 | \n", + "
| 27 | \n", + "2.009500 | \n", + "2.196983 | \n", + "
| 28 | \n", + "2.001000 | \n", + "2.196119 | \n", + "
| 29 | \n", + "1.999600 | \n", + "2.193834 | \n", + "
| 30 | \n", + "1.994700 | \n", + "2.194232 | \n", + "
| 31 | \n", + "1.989700 | \n", + "2.190074 | \n", + "
| 32 | \n", + "1.986000 | \n", + "2.190622 | \n", + "
| 33 | \n", + "1.984700 | \n", + "2.190476 | \n", + "
| 34 | \n", + "1.985800 | \n", + "2.189612 | \n", + "
| 35 | \n", + "1.979400 | \n", + "2.188843 | \n", + "
| 36 | \n", + "1.982600 | \n", + "2.189176 | \n", + "
| 37 | \n", + "1.976900 | \n", + "2.189089 | \n", + "
| 38 | \n", + "1.980700 | \n", + "2.188594 | \n", + "
| 39 | \n", + "1.971000 | \n", + "2.188662 | \n", + "
| 40 | \n", + "1.972800 | \n", + "2.188894 | \n", + "
"
+ ]
+ },
+ "metadata": {}
+ },
+ {
+ "output_type": "execute_result",
+ "data": {
+ "text/plain": [
+ "TrainOutput(global_step=560, training_loss=2.1041604689189364, metrics={'train_runtime': 1362.7743, 'train_samples_per_second': 13.032, 'train_steps_per_second': 0.411, 'total_flos': 8279042209873920.0, 'train_loss': 2.1041604689189364, 'epoch': 40.0})"
+ ]
+ },
+ "metadata": {},
+ "execution_count": 18
+ }
+ ]
+ },
+ {
+ "cell_type": "code",
+ "metadata": {
+ "id": "f2bbac26"
+ },
+ "source": [],
+ "execution_count": null,
+ "outputs": []
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "### ⏰⚡ Demo Time with our trained model🚀😰"
+ ],
+ "metadata": {
+ "id": "3wTOKInCHCjG"
+ }
+ },
+ {
+ "cell_type": "code",
+ "source": [
+ "seed = 2\n",
+ "query = \"Today\"\n",
+ "final_prompt = prompt + query\n",
+ "temperature = 1.0\n",
+ "top_p = 0.9\n",
+ "print('LoRA model')\n",
+ "_ = run_sample(\n",
+ " peft_model,\n",
+ " tokenizer,\n",
+ " prompt=final_prompt,\n",
+ " seed=seed,\n",
+ " temperature=temperature,\n",
+ " top_p=top_p,\n",
+ ")\n"
+ ],
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/",
+ "height": 144
+ },
+ "id": "3kITEkwZHEcp",
+ "outputId": "df6930db-8753-4a30-bf3d-d50b9314f17b"
+ },
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "display_data",
+ "data": {
+ "text/plain": [
+ "\n",
+ " \n",
+ " "
+ ]
+ },
+ "metadata": {}
+ }
+ ]
+ },
+ {
+ "cell_type": "code",
+ "source": [
+ "\n",
+ "print('Original model')\n",
+ "_ = run_sample(\n",
+ " model,\n",
+ " tokenizer,\n",
+ " prompt=final_prompt,\n",
+ " seed=seed,\n",
+ " temperature=temperature,\n",
+ " top_p=top_p,\n",
+ ")"
+ ],
+ "metadata": {
+ "colab": {
+ "base_uri": "https://localhost:8080/"
+ },
+ "id": "NPa-AM8buqVW",
+ "outputId": "d2dbb3dd-a76e-4c03-db33-ddb42457e477"
+ },
+ "execution_count": null,
+ "outputs": [
+ {
+ "output_type": "display_data",
+ "data": {
+ "text/plain": [
+ "🤖 Model: gpt2-medium\n",
+ " \n",
+ " 📝 Prompt: This is a song by The Beatles. It goes like this:\n",
+ "\n",
+ "Today\n",
+ " ✨ Generated: I get into a cab and Im driving, and the weather is nice\n",
+ "We stop for a little coffee and Ill tell my story of my life\n",
+ "You dont see me around the house so you dont know that I am sad\n",
+ "And I get up in the morning, my dog is dead\n",
+ "I go out into the street and Im getting drunk, it is hard to control\n",
+ "A policeman walks past me, I hear he cant stop me\n",
+ "He says, Im on the move\n",
+ "But Im not\n",
+ "Im just on the road and its hard to concentrate\n",
+ "As I ride through the streets, my wife is crying\n",
+ "I get back to the house, Im so lonely\n",
+ "I look at the clock and its 12\n",
+ "And I dont see her\n",
+ "I see her running back home\n",
+ "The sun is shining on my clothes, and I see her in my window\n",
+ "Sitting in the car waiting for my return\n",
+ "Her mother runs into the house\n",
+ "And all she says is that I dont see her\n",
+ "And I dont see her\n",
+ "Im just on the road and its hard to concentrate\n",
+ "So I start back out into the street and its all still the same\n",
+ "Im getting back in the car to\n",
+ " \n",
+ " \n",
+ " "
+ ]
+ },
+ "metadata": {}
+ }
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "source": [
+ "That's it, you've been able to finetune an LLM to generate lyrics from a an artist, look at the response between the LoRA model and the Original model, are you able to spot any differences and if so, can you explain?"
+ ],
+ "metadata": {
+ "id": "gzzau7nVNABr"
+ }
+ },
+ {
+ "cell_type": "code",
+ "source": [],
+ "metadata": {
+ "id": "EzsD-DyvNaZt"
+ },
+ "execution_count": null,
+ "outputs": []
+ }
+ ]
+}
\ No newline at end of file
🤖 Model: gpt2-medium\n",
+ " \n",
+ " 📝 Prompt: This is a song by The Beatles. It goes like this:\n",
+ "\n",
+ "Today\n",
+ " ✨ Generated: I was here\n",
+ "\n",
+ "I don't know where the fuck I am\n",
+ "\n",
+ "I was here when it happened, but\n",
+ "\n",
+ "Now I've got to look at it\n",
+ "\n",
+ "'Cause you've just fucked the whole fucking world\n",
+ "\n",
+ "I had nothing to do with it\n",
+ "\n",
+ "But you just fucked it up\n",
+ "\n",
+ "The world's fucked, it's fucked, it's fucked, it's fucked, it's fucked\n",
+ "\n",
+ "Yeah, it's fucked\n",
+ "\n",
+ "I had nothing to do with it\n",
+ "\n",
+ "But you just fucked it up\n",
+ "\n",
+ "It's fucked, it's fucked, it's fucked, it's fucked\n",
+ "\n",
+ "You got nothing to lose\n",
+ "\n",
+ "It's fucked\n",
+ "\n",
+ "You got nothing to lose\n",
+ "\n",
+ "Yeah, it's fucked\n",
+ "\n",
+ "I had nothing to do with it\n",
+ "\n",
+ "But you just fucked it up\n",
+ "\n",
+ "And fuck it up, fuck it up, fuck it up\n",
+ "\n",
+ "You got nothing to lose\n",
+ "\n",
+ "You got nothing to lose\n",
+ "\n",
+ "But you got nothing to lose\n",
+ "\n",
+ "The world's fucked, it's fucked, it's fucked, it's fucked, it's fucked, it's fucked, it's fucked\n",
+ "\n",
+ "[Interlude\n",
+ "