{"id":1026,"date":"2024-02-11T20:35:57","date_gmt":"2024-02-11T20:35:57","guid":{"rendered":"https:\/\/sparkonelabs.com\/home\/?p=1026"},"modified":"2024-02-28T15:22:34","modified_gmt":"2024-02-28T15:22:34","slug":"basic-openvoice-and-llm-request-script","status":"publish","type":"post","link":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/","title":{"rendered":"Rudimentary Chat Bot – OpenVoice, Whisper & LLM"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n

Using ollama, and the dolphin-2.5-mixtral-8x7b model a simple script to test TTS and requests from Ollama server is being constructed. These are some reference notes.<\/p>\n\n\n\n

    \n
  1. https:\/\/stackoverflow.com\/questions\/17657103\/play-wav-file-in-python<\/a> — Playing Audio in Python<\/li>\n\n\n\n
  2. https:\/\/moez-62905.medium.com\/the-ultimate-guide-to-command-line-arguments-in-python-scripts-61c49c90e0b3#:~:text=In%20Python%2C%20command%2Dline%20arguments,arguments%20passed%20to%20the%20script.<\/a> — Using command line arguments within python script.<\/li>\n\n\n\n
  3. https:\/\/ioflood.com\/blog\/python-run-shell-command\/<\/a> — Running shell command in python using subprocess.<\/li>\n\n\n\n
  4. https:\/\/www.youtube.com\/watch?v=1NonzlRr6JA<\/a> — Robot vocals<\/li>\n<\/ol>\n\n\n\n

    Okay this was successful and resulted in a script called askbot.py<\/code> which is run from a shell script called askbot.sh<\/code>.<\/p>\n\n\n\n

    Recording Audio for an undetermined time<\/h4>\n\n\n\n

    This is the next obvious step, recording audio for an undetermined amount of time… specifically until the user signals that the audio is done being inputted, or preferably when silence is detected from the microphone. To that end, some research was conducted resulting in the following code:<\/p>\n\n\n\n

      \n
    1. https:\/\/stackoverflow.com\/questions\/18406570\/python-record-audio-on-detected-sound<\/a> — stackoverflow result for user defined recording interval<\/li>\n<\/ol>\n\n\n\n

      Okay, with a few minor changes, (Noise threshold to 30db and changing the recording path to \/home\/sparkone\/sdb\/projects\/python\/OpenVoice\/recordings<\/code>) this script appears to be functioning quite nicely.<\/p>\n\n\n\n

      Passing audio files to whisper for speech-to-text transcription<\/h4>\n\n\n\n

      With the audio recording functioning as desired, the next step is getting the recorded audio transcribed into text. Checking for a stop, quit or goodbye type keyword would should suffice for ending the script.<\/p>\n\n\n\n

      For this task, we can use whisper<\/code>, or faster-whisper<\/code> to transcribe the audio offline.<\/p>\n\n\n\n

        \n
      1. https:\/\/github.com\/openai\/whisper<\/a> — whisper project on github<\/li>\n\n\n\n
      2. https:\/\/github.com\/SYSTRAN\/faster-whisper<\/a> — faster-whisper project on github<\/li>\n\n\n\n
      3. https:\/\/github.com\/huggingface\/distil-whisper<\/a> — dustil-whisper<\/li>\n<\/ol>\n\n\n\n

        In order to facilitate functionality of this project, a simple script which takes audio files in will be used initially, then incorporated into the main project. So far we have askbot.py<\/code> and record_3.py<\/code> (3rd attempt at generating a recording script).<\/p>\n\n\n\n

        Update<\/strong>: This worked, as a script. Final iteration of script askbot_3.py<\/code>. <\/p>\n\n\n\n

        NOTES:<\/strong> CUDA memory erros and segmentation faults are resulting from allocation of VRAM outside scopes of reservation. A potential solution is to delegate tasks to separate GPUs. Also upgrading GPU has become important due to this and latency issues. Ideally, a Quadro p8000 would be desired as it offers parallel memory sharing options in the current z series architecture I am using, however cost is prohibitive and a more economical option which does not offer parallel memory sharing in the z series architecture.<\/p>\n\n\n\n

        NOTE<\/strong>: See Neural Network Research Post for specific details regarding PyTorch, Ollama and CUDA<\/p>\n\n\n\n

        Segmentation faults seem to be occurring less, after adjusting model parameters and introducing garbage collection to the script. Additional measures include deleting local variables after use and cleaning cache.<\/p>\n\n\n\n

        It has become apparent that while the recorded audio is being processed, it is still picking up voice audio on the microphone, the recording stream needs to be closed before calling the ollama query and playback function.<\/p>\n\n\n\n

        In order to work around repeat answers and to speed up response time, perhaps utilizing the JSON stream approach would be a practical solution. <\/p>\n\n\n\n

          \n
        1. https:\/\/github.com\/ollama\/ollama\/blob\/main\/docs\/api.md<\/a> — Ollama docs<\/li>\n\n\n\n
        2. https:\/\/www.w3schools.com\/python\/python_json.asp#:~:text=Parse%20JSON%20%2D%20Convert%20from%20JSON,will%20be%20a%20Python%20dictionary.<\/a> — Convert JSON to Python Dictionary<\/li>\n<\/ol>\n\n\n\n

          Request:<\/h4>\n\n\n\n
          <\/circle><\/circle><\/circle><\/g><\/svg><\/span><\/path><\/path><\/svg><\/span>
          curl<\/span> <\/span>http:\/\/localhost:11434\/api\/generate<\/span> <\/span>-d<\/span> <\/span>'<\/span>{<\/span><\/span>\n  "model": "llama2",<\/span><\/span>\n  "prompt": "Why is the sky blue?"<\/span><\/span>\n}<\/span>'<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
          Response (Stream of JSON objects):<\/h4>\n\n\n\n
          <\/circle><\/circle><\/circle><\/g><\/svg><\/span><\/path><\/path><\/svg><\/span>
          {<\/span><\/span>\n  <\/span>"model"<\/span>:<\/span> <\/span>"<\/span>llama2<\/span>"<\/span>,<\/span><\/span>\n  <\/span>"created_at"<\/span>:<\/span> <\/span>"<\/span>2023-08-04T08:52:19.385406455-07:00<\/span>"<\/span>,<\/span><\/span>\n  <\/span>"response"<\/span>:<\/span> <\/span>"<\/span>The<\/span>"<\/span>,<\/span><\/span>\n  <\/span>"done"<\/span>:<\/span> <\/span>false<\/span><\/span>\n}<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
          See the above docs page for more options, such as runtime parameters and showing a model list.<\/p>\n\n\n\n
          Using GPTQ models<\/h4>\n\n\n\n
          Using GPTQ models requires a bit more work than simply downloading and creating a model file as with .gguf. See the following reference:<\/p>\n\n\n\n
            \n
          1. https:\/\/github.com\/ollama\/ollama\/blob\/main\/docs\/import.md<\/a> — Installing and quantizing gptq models<\/li>\n<\/ol>\n\n\n\n
            Apparently this just makes another CPU model out of a GPTQ model. The intention here to fully utilize an NVidia RTX Titan and it’s 25gb VRAM. Trying something else…<\/p>\n\n\n\n
            This looks like it must be run in python, see below reference for a starting point:<\/p>\n\n\n\n
              \n
            1. https:\/\/www.reddit.com\/r\/LocalLLaMA\/comments\/13b3s4f\/how_to_run_starcodergptq4bit128g\/<\/a> — Run .gptq locally?<\/li>\n\n\n\n
            2. https:\/\/huggingface.co\/TheBloke\/medalpaca-13B-GPTQ\/discussions\/3#:~:text=To%20load%20GPTQ%20models%20from,have%20the%20CUDA%20toolkit%20installed.<\/a> — Run GPTQ models locally (theBloke).<\/li>\n\n\n\n
            3. https:\/\/github.com\/oobabooga\/text-generation-webui<\/a> — Oobabooga runs GPTQ<\/li>\n<\/ol>\n\n\n\n
              Okay so the oobabooga\/web-ui<\/code> works for running models fast in the GPU. The issue of extensions is a WIP.<\/p>\n\n\n\n
              Oobabooga\/text-generation-webui Extensions List<\/h2>\n\n\n\n
                \n
              1. https:\/\/github.com\/oobabooga\/text-generation-webui-extensions<\/a> — List of extensions available<\/li>\n<\/ol>\n\n\n\n
                Superbooga (SuperboogaV2)<\/h2>\n\n\n\n
                Getting the following errors when attempting to load extension superbooga<\/code>:<\/p>\n\n\n\n
                <\/circle><\/circle><\/circle><\/g><\/svg><\/span><\/path><\/path><\/svg><\/span>
                01:45:50-406664<\/span> <\/span>ERROR<\/span>    <\/span>Failed<\/span> <\/span>to<\/span> <\/span>load<\/span> <\/span>the<\/span> <\/span>extension<\/span> <\/span>"<\/span>superbooga<\/span>"<\/span>.<\/span>                                                                                                                                                                          <\/span><\/span>\nTraceback<\/span> (most <\/span>recent<\/span> <\/span>call<\/span> <\/span>last<\/span>):<\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span>\/home\/sparkone\/sdb\/projects\/python\/text-generation-webui\/modules\/extensions.py<\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>36<\/span>,<\/span> <\/span>in<\/span> <\/span>load_extensions<\/span><\/span>\n    <\/span>exec<\/span>(f<\/span>"import extensions.{name}.script"<\/span>)<\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span><string><\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>1<\/span>,<\/span> <\/span>in<\/span> <\/span><<\/span>modul<\/span>e<\/span>><\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span>\/home\/sparkone\/sdb\/projects\/python\/text-generation-webui\/extensions\/superbooga\/script.py<\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>10<\/span>,<\/span> <\/span>in<\/span> <\/span><<\/span>modul<\/span>e<\/span>><\/span><\/span>\n    <\/span>from<\/span> <\/span>.chromadb<\/span> <\/span>import<\/span> <\/span>add_chunks_to_collector,<\/span> <\/span>make_collector<\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span>\/home\/sparkone\/sdb\/projects\/python\/text-generation-webui\/extensions\/superbooga\/chromadb.py<\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>1<\/span>,<\/span> <\/span>in<\/span> <\/span><<\/span>modul<\/span>e<\/span>><\/span><\/span>\n    <\/span>import<\/span> <\/span>chromadb<\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span>\/home\/sparkone\/sdb\/projects\/python\/text-generation-webui\/installer_files\/env\/lib\/python3.11\/site-packages\/chromadb\/__init__.py<\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>1<\/span>,<\/span> <\/span>in<\/span> <\/span><<\/span>modul<\/span>e<\/span>><\/span><\/span>\n    <\/span>import<\/span> <\/span>chromadb.config<\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span>\/home\/sparkone\/sdb\/projects\/python\/text-generation-webui\/installer_files\/env\/lib\/python3.11\/site-packages\/chromadb\/config.py<\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>1<\/span>,<\/span> <\/span>in<\/span> <\/span><<\/span>modul<\/span>e<\/span>><\/span><\/span>\n    <\/span>from<\/span> <\/span>pydantic<\/span> <\/span>import<\/span> <\/span>BaseSettings<\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span>\/home\/sparkone\/sdb\/projects\/python\/text-generation-webui\/installer_files\/env\/lib\/python3.11\/site-packages\/pydantic\/__init__.py<\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>374<\/span>,<\/span> <\/span>in<\/span> <\/span>__getattr__<\/span><\/span>\n    <\/span>return<\/span> <\/span>_getattr_migration<\/span>(<\/span>attr_name<\/span>)<\/span><\/span>\n           <\/span>^^^^^^^^^^^^^^^^^^^^^^^^^^^^^<\/span><\/span>\n  <\/span>File<\/span> <\/span>"<\/span>\/home\/sparkone\/sdb\/projects\/python\/text-generation-webui\/installer_files\/env\/lib\/python3.11\/site-packages\/pydantic\/_migration.py<\/span>"<\/span>,<\/span> <\/span>line<\/span> <\/span>296<\/span>,<\/span> <\/span>in<\/span> <\/span>wrapper<\/span><\/span>\n    <\/span>raise<\/span> <\/span>PydanticImportError<\/span>(<\/span><\/span>\npydantic.errors.PydanticImportError:<\/span> <\/span>`<\/span>BaseSettings<\/span>`<\/span> <\/span>has<\/span> <\/span>been<\/span> <\/span>moved<\/span> <\/span>to<\/span> <\/span>the<\/span> <\/span>`<\/span>pydantic-settings<\/span>`<\/span> <\/span>package.<\/span> <\/span>See<\/span> <\/span>https:\/\/docs.pydantic.dev\/2.6\/migration\/#basesettings-has-moved-to-pydantic-settings<\/span> <\/span>for<\/span> <\/span>more<\/span> <\/span>details.<\/span><\/span>\n<\/span>\nFor<\/span> <\/span>further<\/span> <\/span>information<\/span> <\/span>visit<\/span> <\/span>https:\/\/errors.pydantic.dev\/2.6\/u\/import-error<\/span><\/span>\n<\/span><\/code><\/pre><\/div>\n\n\n\n
                This error is apparently common on the user install regardless of the operating system used. The following version corrections worked:<\/p>\n\n\n\n
                <\/circle><\/circle><\/circle><\/g><\/svg><\/span><\/path><\/path><\/svg><\/span>
                .\/cmd_linux.sh<\/span> <\/span>## Load the conda environment to select the correct pip<\/span><\/span>\npip<\/span> <\/span>install<\/span> <\/span>chromadb==<\/span>0.3<\/span>.18<\/span> <\/span>## Select the compatible version of chromadb for superbooga<\/span><\/span>\npip<\/span> <\/span>install<\/span> <\/span>pydantic==<\/span>1.10<\/span>.14<\/span> <\/span>## Select the compatible version of pydantic for superbooga<\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
                This worked.<\/p>\n\n\n\n
                NOTE<\/strong>: To use ingested data as context, the notebook mode must be utilized and the following tags employed:<\/p>\n\n\n\n
                “There is technically documentation for it, but you are right that it’s not super obvious. Right under the superbooga header there is a thin pane with the text “Click for more information…” if you click on that it will expand and give you a somewhat detailed explanation of how superbooga works.<\/em><\/p>\n\n\n\n
                But I can summarize the key information. For one, superbooga operates differently depending on whether you are using the chat interface or the notebook\/default interface. In the chat interface it does not actually use the information you submit to the database, instead it automatically inserts old messages into the database and automatically retrieves them based on your current chat message.<\/em><\/p>\n\n\n\n
                To query information you have submitted you need to change to the notebook\/default interface. In those modes you can insert the following three special tokens:”<\/em><\/p>\n\n\n\n
                <\/circle><\/circle><\/circle><\/g><\/svg><\/span><\/path><\/path><\/svg><\/span>
                <|<\/span>begin-user-input<\/span>|><\/span><\/span>\n<|<\/span>end-user-input<\/span>|><\/span><\/span>\n<|<\/span>injection-point<\/span>|><\/span><\/span><\/code><\/pre><\/div>\n\n\n\n
                  \n
                1. https:\/\/github.com\/oobabooga\/text-generation-webui\/issues\/2824<\/a> — Reference for superbooga data injection.<\/li>\n<\/ol>\n\n\n\n
                  EmotiVoice (Decent Latency)<\/h2>\n\n\n\n
                  See:<\/p>\n\n\n\n
                    \n
                  1. https:\/\/github.com\/yhyu13\/Emotivoice_TTS<\/a> — Installation instructions, after downloading the model using the UI<\/li>\n<\/ol>\n\n\n\n
                    It looks like this one uses some sort of remote access, it would be preferable to use OpenVoice locally… <\/p>\n\n\n\n
                    TODO<\/strong>: Find or write extension for OpenVoice, as it has decent latency as well<\/p>\n\n\n\n
                    LucidWebSearch<\/h2>\n\n\n\n
                    This is an interesting extension which can use OCR models (e.g; nougat<\/code>) to retrieve and utilize web resources and optionally parse\/generate markup containing mathematical expressions.<\/p>\n\n\n\n
                    See:<\/p>\n\n\n\n
                      \n
                    1. https:\/\/github.com\/RandomInternetPreson\/LucidWebSearch?tab=readme-ov-file<\/a> — Web Search and Math Search Extension<\/li>\n<\/ol>\n\n\n\n
                      OpenVoice Extension<\/h2>\n\n\n\n
                      After using OpenVoice<\/code> in a script testing listening and STT\/TTS around an ollama GGUF model, I desired to implement a custom extension utilizing it as well for oobabooga\/text-generation-webui<\/code>. However I encountered the following errors after pip install -r requirements<\/code> in extensions\/OpenVoice<\/code>:<\/p>\n\n\n\n
                      <\/circle><\/circle><\/circle><\/g><\/svg><\/span><\/path><\/path><\/svg><\/span>
                      INFO:<\/span> <\/span>pip<\/span> <\/span>is<\/span> <\/span>looking<\/span> <\/span>at<\/span> <\/span>multiple<\/span> <\/span>versions<\/span> <\/span>of<\/span> <\/span>wavmark<\/span> <\/span>to<\/span> <\/span>determine<\/span> <\/span>which<\/span> <\/span>version<\/span> <\/span>is<\/span> <\/span>compatible<\/span> <\/span>with<\/span> <\/span>other<\/span> <\/span>requirements.<\/span> <\/span>This<\/span> <\/span>could<\/span> <\/span>take<\/span> <\/span>a<\/span> <\/span>while.<\/span><\/span>\nERROR:<\/span> <\/span>Ignored<\/span> <\/span>the<\/span> <\/span>following<\/span> <\/span>yanked<\/span> <\/span>versions:<\/span> <\/span>2.0<\/span>.0<\/span><\/span>\nERROR:<\/span> <\/span>Ignored<\/span> <\/span>the<\/span> <\/span>following<\/span> <\/span>versions<\/span> <\/span>that<\/span> <\/span>require<\/span> <\/span>a<\/span> <\/span>different<\/span> <\/span>python<\/span> <\/span>version:<\/span> <\/span>1.21<\/span>.2<\/span> <\/span>Requires-Python<\/span> <\/span>><\/span>=<\/span>3.7<\/span>,<\/span><<\/span>3.11<\/span>;<\/span> <\/span>1.21.3<\/span> <\/span>Requires-Python<\/span> <\/span>><\/span>=<\/span>3.7<\/span>,<\/span><<\/span>3.11<\/span>;<\/span> <\/span>1.21.4<\/span> <\/span>Requires-Python<\/span> <\/span>><\/span>=<\/span>3.7<\/span>,<\/span><<\/span>3.11<\/span>;<\/span> <\/span>1.21.5<\/span> <\/span>Requires-Python<\/span> <\/span>><\/span>=<\/span>3.7<\/span>,<\/span><<\/span>3.11<\/span>;<\/span> <\/span>1.21.6<\/span> <\/span>Requires-Python<\/span> <\/span>><\/span>=<\/span>3.7<\/span>,<\/span><<\/span>3.11<\/span><\/span>\nERROR:<\/span> <\/span>Could<\/span> <\/span>not<\/span> <\/span>find<\/span> <\/span>a<\/span> <\/span>version<\/span> <\/span>that<\/span> <\/span>satisfies<\/span> <\/span>the<\/span> <\/span>requirement<\/span> <\/span>torchaudio<\/span><<\/span>2.0<\/span> (from <\/span>wavmark<\/span>) <\/span>(<\/span>from<\/span> <\/span>versions:<\/span> <\/span>2.0<\/span>.1,<\/span> <\/span>2.0<\/span>.2,<\/span> <\/span>2.1<\/span>.0,<\/span> <\/span>2.1<\/span>.1,<\/span> <\/span>2.1<\/span>.2,<\/span> <\/span>2.2<\/span>.0,<\/span> <\/span>2.2<\/span>.1<\/span>)<\/span><\/span>\nERROR:<\/span> <\/span>No<\/span> <\/span>matching<\/span> <\/span>distribution<\/span> <\/span>found<\/span> <\/span>for<\/span> <\/span>torchaudio<\/span><<\/span>2.0<\/span><\/span>\n<\/span><\/code><\/pre><\/div>\n\n\n\n
                      Not sure how to proceed from here… Is it possible to use 2 different virtual environments in the same running instance of the webui?<\/p>\n\n\n\n
                      TODO<\/strong>: Check and determine whether this is possible\/practical.<\/p>\n\n\n\n
                      Context Window Research and Methods<\/h2>\n\n\n\n
                      The context window size is an important factor in the practical application of models, and to that end various articles are included as reference for research notes.<\/p>\n\n\n\n
                        \n
                      1. https:\/\/medium.com\/@ddxzzx\/why-and-how-to-achieve-longer-context-windows-for-llms-5f76f8656ea9#:~:text=Once%20we%20have%20efficiently%20incorporated,fit%20the%20new%20context%20length.<\/a> — Article on RoPE and other context enlargement methods<\/li>\n<\/ol>\n\n\n\n\n\n
                        Research References<\/h2>\n\n\n\n
                          \n
                        1. https:\/\/en.wikipedia.org\/wiki\/DeepSpeed<\/a> — DeepSpeed Wiki<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"
                          Using ollama, and the dolphin-2.5-mixtral-8x7b model a simple script to test TTS and requests from Ollama server is being constructed. These are some reference notes. Okay this was successful and resulted in a script called askbot.py which is run from a shell script called askbot.sh. Recording Audio for an undetermined time This is the next<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_hide_featured_image":false,"_jetpack_featured_image_duplicate_dismissed":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1026","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"\nRudimentary Chat Bot - OpenVoice, Whisper & LLM - SparkOne() Labs Official Site<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Rudimentary Chat Bot - OpenVoice, Whisper & LLM - SparkOne() Labs Official Site\" \/>\n<meta property=\"og:description\" content=\"Using ollama, and the dolphin-2.5-mixtral-8x7b model a simple script to test TTS and requests from Ollama server is being constructed. These are some reference notes. Okay this was successful and resulted in a script called askbot.py which is run from a shell script called askbot.sh. Recording Audio for an undetermined time This is the next\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/\" \/>\n<meta property=\"og:site_name\" content=\"SparkOne() Labs Official Site\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/profile.php?id=61551444286908\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-11T20:35:57+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-28T15:22:34+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/02\/brain_electric_0-0-1024x796.png\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@sparkonelabs\" \/>\n<meta name=\"twitter:site\" content=\"@sparkonelabs\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#\\\/schema\\\/person\\\/ee3bd21f007818ac04abf178e749642c\"},\"headline\":\"Rudimentary Chat Bot – OpenVoice, Whisper & LLM\",\"datePublished\":\"2024-02-11T20:35:57+00:00\",\"dateModified\":\"2024-02-28T15:22:34+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/\"},\"wordCount\":1195,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/wp-content\\\/uploads\\\/2024\\\/02\\\/brain_electric_0-0-1024x796.png\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/\",\"url\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/\",\"name\":\"Rudimentary Chat Bot - OpenVoice, Whisper & LLM - SparkOne() Labs Official Site\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/wp-content\\\/uploads\\\/2024\\\/02\\\/brain_electric_0-0-1024x796.png\",\"datePublished\":\"2024-02-11T20:35:57+00:00\",\"dateModified\":\"2024-02-28T15:22:34+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#primaryimage\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/sparkonelabs.com\\\/home\\\/wp-content\\\/uploads\\\/2024\\\/02\\\/brain_electric_0-0.png?fit=1152%2C896&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/sparkonelabs.com\\\/home\\\/wp-content\\\/uploads\\\/2024\\\/02\\\/brain_electric_0-0.png?fit=1152%2C896&ssl=1\",\"width\":1152,\"height\":896},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/2024\\\/02\\\/11\\\/basic-openvoice-and-llm-request-script\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Rudimentary Chat Bot – OpenVoice, Whisper & LLM\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#website\",\"url\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/\",\"name\":\"SparkOne() Labs Official Site\",\"description\":\"SparkOne Labs is a Science, Art and Technology blog. Email: sparkonelabs@sparkonelabs.com\",\"publisher\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#organization\"},\"alternateName\":\"SparkOne Labs\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#organization\",\"name\":\"SparkOne() Labs\",\"alternateName\":\"SparkOne Labs\",\"url\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/logo_sparkone_12.png\",\"contentUrl\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/logo_sparkone_12.png\",\"width\":1152,\"height\":896,\"caption\":\"SparkOne() Labs\"},\"image\":{\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/profile.php?id=61551444286908\",\"https:\\\/\\\/x.com\\\/sparkonelabs\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/#\\\/schema\\\/person\\\/ee3bd21f007818ac04abf178e749642c\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/bc8a8c84ca952e624e7407ec63589bc91e7996574dee7a01c13a96c536c341e9?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/bc8a8c84ca952e624e7407ec63589bc91e7996574dee7a01c13a96c536c341e9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/bc8a8c84ca952e624e7407ec63589bc91e7996574dee7a01c13a96c536c341e9?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\\\/\\\/sparkonelabs.com\\\/home\"],\"url\":\"https:\\\/\\\/sparkonelabs.com\\\/home\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Rudimentary Chat Bot - OpenVoice, Whisper & LLM - SparkOne() Labs Official Site","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/","og_locale":"en_US","og_type":"article","og_title":"Rudimentary Chat Bot - OpenVoice, Whisper & LLM - SparkOne() Labs Official Site","og_description":"Using ollama, and the dolphin-2.5-mixtral-8x7b model a simple script to test TTS and requests from Ollama server is being constructed. These are some reference notes. Okay this was successful and resulted in a script called askbot.py which is run from a shell script called askbot.sh. Recording Audio for an undetermined time This is the next","og_url":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/","og_site_name":"SparkOne() Labs Official Site","article_publisher":"https:\/\/www.facebook.com\/profile.php?id=61551444286908","article_published_time":"2024-02-11T20:35:57+00:00","article_modified_time":"2024-02-28T15:22:34+00:00","og_image":[{"url":"https:\/\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/02\/brain_electric_0-0-1024x796.png","type":"","width":"","height":""}],"author":"admin","twitter_card":"summary_large_image","twitter_creator":"@sparkonelabs","twitter_site":"@sparkonelabs","twitter_misc":{"Written by":"admin","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#article","isPartOf":{"@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/"},"author":{"name":"admin","@id":"https:\/\/sparkonelabs.com\/home\/#\/schema\/person\/ee3bd21f007818ac04abf178e749642c"},"headline":"Rudimentary Chat Bot – OpenVoice, Whisper & LLM","datePublished":"2024-02-11T20:35:57+00:00","dateModified":"2024-02-28T15:22:34+00:00","mainEntityOfPage":{"@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/"},"wordCount":1195,"commentCount":0,"publisher":{"@id":"https:\/\/sparkonelabs.com\/home\/#organization"},"image":{"@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#primaryimage"},"thumbnailUrl":"https:\/\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/02\/brain_electric_0-0-1024x796.png","inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/","url":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/","name":"Rudimentary Chat Bot - OpenVoice, Whisper & LLM - SparkOne() Labs Official Site","isPartOf":{"@id":"https:\/\/sparkonelabs.com\/home\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#primaryimage"},"image":{"@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#primaryimage"},"thumbnailUrl":"https:\/\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/02\/brain_electric_0-0-1024x796.png","datePublished":"2024-02-11T20:35:57+00:00","dateModified":"2024-02-28T15:22:34+00:00","breadcrumb":{"@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#primaryimage","url":"https:\/\/i0.wp.com\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/02\/brain_electric_0-0.png?fit=1152%2C896&ssl=1","contentUrl":"https:\/\/i0.wp.com\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/02\/brain_electric_0-0.png?fit=1152%2C896&ssl=1","width":1152,"height":896},{"@type":"BreadcrumbList","@id":"https:\/\/sparkonelabs.com\/home\/2024\/02\/11\/basic-openvoice-and-llm-request-script\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sparkonelabs.com\/home\/"},{"@type":"ListItem","position":2,"name":"Rudimentary Chat Bot – OpenVoice, Whisper & LLM"}]},{"@type":"WebSite","@id":"https:\/\/sparkonelabs.com\/home\/#website","url":"https:\/\/sparkonelabs.com\/home\/","name":"SparkOne() Labs Official Site","description":"SparkOne Labs is a Science, Art and Technology blog. Email: sparkonelabs@sparkonelabs.com","publisher":{"@id":"https:\/\/sparkonelabs.com\/home\/#organization"},"alternateName":"SparkOne Labs","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sparkonelabs.com\/home\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sparkonelabs.com\/home\/#organization","name":"SparkOne() Labs","alternateName":"SparkOne Labs","url":"https:\/\/sparkonelabs.com\/home\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sparkonelabs.com\/home\/#\/schema\/logo\/image\/","url":"https:\/\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/01\/logo_sparkone_12.png","contentUrl":"https:\/\/sparkonelabs.com\/home\/wp-content\/uploads\/2024\/01\/logo_sparkone_12.png","width":1152,"height":896,"caption":"SparkOne() Labs"},"image":{"@id":"https:\/\/sparkonelabs.com\/home\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/profile.php?id=61551444286908","https:\/\/x.com\/sparkonelabs"]},{"@type":"Person","@id":"https:\/\/sparkonelabs.com\/home\/#\/schema\/person\/ee3bd21f007818ac04abf178e749642c","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/bc8a8c84ca952e624e7407ec63589bc91e7996574dee7a01c13a96c536c341e9?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/bc8a8c84ca952e624e7407ec63589bc91e7996574dee7a01c13a96c536c341e9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bc8a8c84ca952e624e7407ec63589bc91e7996574dee7a01c13a96c536c341e9?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/sparkonelabs.com\/home"],"url":"https:\/\/sparkonelabs.com\/home\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/posts\/1026","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/comments?post=1026"}],"version-history":[{"count":4,"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/posts\/1026\/revisions"}],"predecessor-version":[{"id":1119,"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/posts\/1026\/revisions\/1119"}],"wp:attachment":[{"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/media?parent=1026"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/categories?post=1026"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sparkonelabs.com\/home\/wp-json\/wp\/v2\/tags?post=1026"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}