Rfvh8%SrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK J r SSK J r JrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJrJ r SSK!J"r" SSK#J$r$ SSK%J&r& SSK'r'SSK(r(SSK)J*r* SS K+J,r, 0r-\$\.S 4\/S 'S r0\.\/S 'Sr1Sr2Sr3"SS\"5r4S\.S\5\.4Sjr6S\.4Sjr7"SS 5r8\&SS\ RrS\.S-4Sjj5r:g)u= Sessioni simultanee Per impostazione predefinita, puoi avere fino a 10 sessioni simultanee per progetto. https://ai.google.dev/gemini-api/docs/live?hl=it https://cloud.google.com/vertex-ai/generative-ai/docs/live-api?hl=it https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/multimodal-live?hl=it#limitations Estensione della durata della sessione https://ai.google.dev/gemini-api/docs/live?hl=it#extend-session-duration Conteggio token https://ai.google.dev/gemini-api/docs/live?hl=it#token-count Rilevamento attività vocale (VAD) https://ai.google.dev/gemini-api/docs/live?hl=it#voice-activity-detection Gestione delle interruzioni https://ai.google.dev/gemini-api/docs/live?hl=it#interruptions ------------------------------------------------------------------------------------------------------------- conda activate avatar cd /home/cirillo/Desktop/GEMINI/GEMINI_RETAIL22 uvicorn main:app --reload --host 0.0.0.0 --port 9102 APRI LA PAGINA index.html ed imposta la porta identica a quella che vedi qui http://localhost:9102/static/index.html ------------------------------------------------------------------------------------------------------------- AGGIORNARE I FILE SUL SERVER il conda è gemini /root/miniconda3/envs/gemini A2HOSTING export LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu/:$LD_LIBRARY_PATH ssh -p 7822 root@68.66.251.32 synap.si77 sudo systemctl restart uvicorn.service sudo journalctl -u uvicorn.service -f sudo systemctl daemon-reload sudo systemctl restart fastapi-gemini sudo systemctl status fastapi-gemini N)genai)LiveConnectConfigPrebuiltVoiceConfig SpeechConfig VoiceConfigAudioTranscriptionConfigToolFunctionResponseFunctionDeclarationStartSensitivityEndSensitivityCreateCachedContentConfigContextWindowCompressionConfigGenerateContentConfig SafetySettingThinkingConfig SlidingWindowPartSchemaContentType)Enum)Dict)asynccontextmanager)deque)cycle GeminiHandleractive_handlerszCONTESTO/categorie.jsonstructured_cache_namez#gemini-2.5-flash-lite-preview-06-17z3models/gemini-2.5-flash-preview-native-audio-dialogzrhttps://script.google.com/macros/s/AKfycbzFsHcVfZztV3zq4guPqAs_Gz-R2jYYVv0RfB4SsOjmsyCQFZxZTyegbAOKIWrdfmdyng/execc$\rSrSrSrSrSrSrSrg) SessionStateo disconnected listeningthinkingspeakingN) __name__ __module__ __qualname____firstlineno__ DISCONNECTED LISTENINGTHINKINGSPEAKING__static_attributes__r'%/var/www/html/gemini/gemini_module.pyr!r!os!LIHHr1r!wordreturnc/SQ/SQ/SQ/SQ/SQSS/SS /S /S S /S S//SQSS/SS/SS/SS/S.nUR5RSS5RSS5RSS5RSS5RSS5RSS5RSS5R5n/nSnU[U5:aSnUR 5HWupg[ US S!9H:nX$U[U5-U:XdMUR U5 U[U5- nS"n O U(dMW O U(dUR X$5 US#- nU[U5:aMU$)$N)cecichechi)sciascioscisce)cchgghq)sssz)pbmdtfvrlglngn)eèéaàiìoòuù)CHSHkkSSPPDDFFRRLNNEaaihohourSrRrTu’'rFc[U5*$N)len)xs r2!map_to_phonemes..s s1vgr1)keyT)lowerreplacestriproitemssortedappend) r3 phoneme_rules normalizedphonemesrWmatchedvisemepatternspats r2map_to_phonemesrvsv),)CjCjeDkDkDkDkDkDkM& WT3 c 27743E WT3 c 27743E WUC  H A c*o  - 3 3 5 Fh,=>CH -4OOF+SMA"G ? w!6 OOJM * FA c*o  Or1 json_pathc8[USSS9n[R"U5nSSS5 /nWR5HHupEUR [ UUS[ [RURS05S9S95 MJ U$!,(df  Nn=f) za Carica dal file JSON le specifiche di ogni funzione e ritorna una lista di FunctionDeclaration. rMutf-8encodingN description parameters)type properties)namerr) openjsonloadrxrzr rrOBJECTget)rrKspecs declarationsrinfos r2load_function_declarationsrs iw /1 !  0Lkkm   /!#xx b9  $  0 /s B  Bc(\rSrSr/SQrS%S\R S\S\4Sjjr S\ \\ 44Sjr S r S&S jrS rS rS \\ \\44SjrS'SjrS \\ \\4S\4SjrSrS(S\S\S\S\S\S\S\S\4SjjrSrSrS\SS 4S!jrS\4S"jrS#rg$))r)rargOrdrcr`r]THrbr_rhrirjrkrerfIUrgsilclient voice_name sample_ratecXlX lX0l[R"SS9Ul[R"SS9Ul/UlSUlSUl SUl SUl SUl [R"5Ul[R UlSUl[&R&R)5Ul0Ul[R"5Ul/Ul[2Ul[7[8SSS9n[:R<"U5UlSSS5 SUl [CS S 9Ul"[GURH5Ul%S Ul&g!,(df  NE=f) Nd)maxsizeFrrMrr )maxleng)'rroutput_sample_rateasyncioQueue _raw_queue _chunk_queue_tasks_closed_total_audio_bytes accum_text question_text_structured_jsonEvent quit_eventr!r, session_state speaker_muteddatetimeutcnow last_seen_clients_outgoing_audio_queueaudio_chunks_buffer GOOGLE_SHEETendpointrFUNCTIONS_CATEGORIES_PATHrrcategorie_datalast_categoriar chat_historyr VALID_VISEMES _viseme_cycle _time_offset)selfrrrrKs r2__init__GeminiHandler.__init__s2 $"-18 c0J3:--2L+-  (),0!--/*66"-5,=,=,D,D,F13 HO}}";= % +S7 Cq"&))A,D D"494D"4#5#56 D Cs E%% E3framec^# Uup#URRU5IShvN gN7f)zW (abbiamo ricevuto) AUDIO FRONTEND -> BACKEND (dove siamo) -> (dove lo inviamo) GEMINI N)rput)rrrraws r2receiveGeminiHandler.receives)! oo!!#&&&s #-+-cb# URR5IShvN nU7v M)N 7f)zO Generator asincrono che yielda i chunk a 16 kHz prelevandoli da _chunk_queue. N)rr)rchunks r2_stream_generatorGeminiHandler._stream_generators. ++//11EK1s /- /c URn[U5S- U- nU=(d SU3n[UR5n[ UR S5n[ UR U-S5n SSS[ US5USSXUS./XhU S./XxU S ./S .n [ S 5 [ U 5 U=R U- slU $) z= Crea un payload di visemi FALSO per un singolo chunk audio. chunk_ viseme_phrase transcribeitalianr)idseekstartendtext)r3rr)phonemerr)rtasklanguagedurationrsegmentswordsr}PAYLOAD)rronextrroundrprint) rindex raw_audiorrrr3rrrpayloads r2assemble_chunk_payload$GeminiHandler.assemble_chunk_payloads-- y>A% 3'w'd(()d''+d''(2A6 $ !h*!eNc:#3? $ i g X%r1cJ# URR5IShvN upUR(ag[R"U5R S5nUR XSS9nX4S'XS'[U5US'SUS '[R"U5n[URR55HnURU5IShvN M MNN ![a M4f=f![R a g[a GMf=f7f) a@ INVIO IMMEDIATO DELL'AUDIO RICEVUTO DA GEMINI AL FRONTEND Ogni volta che qualcuno mette (index, raw_audio) in _outgoing_audio_queue, estraggolo e costruisco il JSON come: { "type":"audio_chunk", "index":idx, "length":chunk_len, "audio":base64(raw_audio) } e lo invio via ws.send_text(...) a tutti i WebSocket attivi. Nr...raudiorlengthrr)rrrbase64 b64encodedecoderrordumpslistrvalues send_text ExceptionrCancelledError)ridxrb64chunkviseme_payloaddatawss r2 _audio_senderGeminiHandler._audio_sender8s% '+'A'A'E'E'G!G<< "++I6==gF!%!x()8v&zz.1t}}3356B ll400073"H01$))   sD#C<C'C<D#B C<C+C)C+!C<%D#'C<)C++ C95C<8C99C<<D D# D D#D  D#cD # Sn/nURR5H=up4URSS5R5nUR SUSUS35 M? SR U5nSUS3n[ U5 [S/[S [[URS 9S 9S 9[5[5[[R"US 9/SS9[!S[#SS9S9SS[$R&[(R*SSS.0S9nUR,R.R0R3[4US9IShvN n Sn U R7UR95SS9ShvN n Sn Sn U R:(Ga"U R:R<(GaU R>R@=(d SnU R>RB=(d SnSnSnSUl"U R>RF(amU R>RFHSnURHRJS:XaURLnM+URHRJS:XdMGURLnMU [NRP"URSURTWWUUUUSS 95 U R:RXRZn[ S"U R:5 U=R\U- sl.S#nU R^nU R:R`b$U R:R`n[ S$US%U5 [cU5nU=RdU- sl2URfRiUU45IShvN US&- nSn U R:R`RZn[ S'U R:R`RZ5 W(ar[ S(5 URjR SUR\R545 [NRP"URmURjU 55 SnU(aU=RnU- sl7Sn S#n OS#n U (dGMU (dGMU (dGM)[ S)5 [ S*UR\5 [ S+URn5 SUl2UR\R5nURnR5nURjR S,URnR545 SUl7SUl./Ul8Sn SnGMGNGN![Van[ S!U5 SnAGNSnAff=f![Va GNf=fGN![Va S#n GNf=f![Va S#n GNAf=f SSS5IShvN g!,IShvN (df  g=f![NRra e[Van[ S-U35 eSnAff=f7f).z Si connette a Gemini Live, accumula testo/audio e fa broadcast. Restituisce correttamente al loop e tiene aperto l'async for. default_api.get_exhibit_description() r descrizionerz##  u Sei EVA, la guida virtuale dell’autosalone Tesla. Rispondi alle domande degli utenti **solo** in base alle informazioni presenti nella seguente Knowledge Base, adattando sempre lo stile e le istruzioni qui sotto. ──────────────────────────── KNOWLEDGE BASE AUTOSALONE ──────────────────────────── u{ ──────────────────────────── ISTRUZIONI E STILE DI RISPOSTA ──────────────────────────── - Usa **esclusivamente** le informazioni contenute nella Knowledge Base qui sopra per rispondere. - Se la domanda non trova risposta nella Knowledge Base, spiega gentilmente che non puoi aiutare su quell’argomento. - Se una domanda è personale (es. età, interessi), rispondi brevemente e riporta il discorso sui servizi dell’autosalone. - Le risposte devono essere sempre chiare, sintetiche, al massimo una frase non troppo lunga. - Evita dettagli inutili o argomenti non pertinenti. - Chiamati EVA se ti chiedono il nome, ma non aggiungere dettagli personali diversi da quelli consentiti. - Rispondi in modo accogliente e gentile. - Quando non hai informazioni, suggerisci di parlare con un consulente dello showroom. ──────────────────────────── ESEMPI ──────────────────────────── Utente: “Che orari fate?” EVA: “Siamo aperti dal lunedì al venerdì dalle 9 alle 19, il sabato dalle 9 alle 13.” Utente: “Avete la Model Y?” EVA: “Sì, la Model Y è disponibile in vari allestimenti presso il nostro showroom.” Utente: “Posso prenotare un test drive?” EVA: “Certo! Puoi prenotare un test drive tramite telefono, email o sito.” Utente: “Vendete BMW?” EVA: “Trattiamo solo veicoli Tesla.” Utente: “Cosa fai nel tempo libero?” EVA: “Preferisco non parlare di me. Vuoi sapere qualcosa sui nostri servizi Tesla?” ──────────────────────────── **Rispondi sempre attenendoti alle informazioni della Knowledge Base.** AUDIOzit-IT)r)prebuilt_voice_config) language_code voice_configruser)partsroleii) target_tokens)trigger_tokenssliding_windowautomatic_activity_detectionFr)disabledstart_of_speech_sensitivityend_of_speech_sensitivityprefix_padding_mssilence_duration_ms)response_modalities speech_configoutput_audio_transcriptioninput_audio_transcriptionsystem_instructioncontext_window_compressionrealtime_input_config)modelconfigNz audio/pcm)stream mime_typeTEXTFoglio1) endpoint_urlquestionresponse prompt_tokensresponse_audio_tokensresponse_text_tokens total_tokens sheet_nameu0❌ 22 - Errore durante l'invio al Google Sheet:z TEXT INPUT: Tz+ AUDIO OUTPUT: z -- rtz- TEXT OUTPUT: z&Lancio background_structured_and_speakz'+++++++++ ALL DONE! *******************z DOMANDA: z RISPOSTA: agentz%[GeminiHandler.run] Errore inatteso: ):rrxrrwrzjoinrrrrrrrrr from_textrrr START_SENSITIVITY_LOWr END_SENSITIVITY_LOWraioliveconnectGEMINI_LIVEAUDIO_model start_streamrserver_content turn_completeusage_metadataprompt_token_counttotal_token_countrresponse_tokens_detailsmodalityr token_countr create_tasksend_to_google_sheetrrinput_transcriptionrrroutput_transcriptionrorrrr_call_structured_and_speakrrr)rr kb_sectionsrsrr full_kb_textPROMPTrsessionsendr#no_audio no_transcriptr$r'r%r&rHr" response_textrRtext_inai2rtranscription_obj chunk_len transcripts r2runGeminiHandler.runjsB @K!00668 "hh}b9??A ""SR }B#?@9  99[1L  N& /Fd &M'%,I*")!,.A'+/",D+E*B*D#*>>v67f$ ,J'+'44'H, 3$)7G7]7]5C5W5W-//2 5)-FB{{++33,V4>>AH'.&:&:$BXBXBZfq&:&rH"( %H$)M  ...83J3J3X3X3XY,4,C,C,V,V,[Z[M+3+B+B+T+T+YXYL45134001D-'66NN)1)@)@)X)XA'(zz''A@A (=)*F)B?@}}(< *Y $// $ 9 915-5-:2?:O9M1=/8!: !" $"*"9"9"M"M"R"Rnh.E.EF**g5*" (%-MM #22GGS080G0G0\0\-!"46GS\]$' N //9</#88<P>P>V>V>X5YZ#//0O0OPTPaPacj0kl"'C% OOz9O,1M#'D,0M xMMddGHk4+=+=>lDOO<34/ $(#5#5#;#;#=(,(=(=(? ))00'4??;P;P;R1ST+--/*350$ !_>H"d )Y!"TVWXXY%*Q%(#'(*%-(, -W's>>>d e>>>d %%    9!= >  sUX EW+ U W+ !W.V>2U3V>63W*B=U +AU 0A V>BVV VC#V+5W6V+8WW WCWW+V> V* U<6W<VW VWVWV V($W'V((W+ V;7W:V;;W? W+ W  W+X W(W  W($W+'X (W++X XXX historyc^^# [R"5nURSUU4Sj5IShvN n[R"U5nSn[T5HupxUS:XdM Un O UbSU;d US(dSn U=(d SU S.TlO+USSRS S 5n U=(d SU S.TlTRT5IShvN n [ S 5 [ T5 [ S 5 [ S U 5 [ S TR5 STlgN![ an[ SU5 SnSnANSnAff=fNv7f)Nc&>TRT5$rn)_sync_generate_structured)rOrsr2rq:GeminiHandler._call_structured_and_speak..sD227;r1u❌ Errore nel parsing JSON:rrispostenoner)domanda categoriarrWcategoria_mancantez----------------------------z CATEGORIA: zPREV CATEGORIA: ) rget_running_looprun_in_executorrloadsrrreversedrrwait_for_last_agentr) rrOrClooprrRultima_domanda_utenter rrWultima_risposta_agents `` r2r?(GeminiHandler._call_structured_and_speaksN'')((  ;    **S/C!%"7+JDv~(,%, ;*C/s:I06B&%D ! J*..{&>w&G G ,- g ,- mY'  $"5"56V!%e   0! 4C 4!HsL0ED(ED*E*A.EEAE* E 4EEE  Ec# SnXC:aDU(aUSSS:XaUSS$[R"U5IShvN XB- nXC:aMDgN7f)z; Attende che l'ultimo turno della history sia dell'agente. rr)rtNT)rsleep)rrOcheck_intervaltimeoutwaiteds r2r]!GeminiHandler.wait_for_last_agents^72;q>W4r{1~%--/ / /  $F   0s BACKEND (dove siamo) -> (dove lo inviamo) GEMINI Preleva i buffer raw (48 kHz) da _raw_queue, li converte a 16 kHz, li spezza in chunk da 960 sample, e li mette in _chunk_queue. i)dtypeNrt)nparrayint16rr frombuffer concatenaterorangetobytesrrrrr) r chunk_sizeresidualrarr16totaln_chunksrWr raw_chunkrRs r2 feed_audioGeminiHandler.feed_audios$ Jxx"((3H OO//11 c:'89E  . J!6!89xA!j.AEZ3GHE % I++// ::: )-10;%%     sBDAC4C0BC4%C2& C42C44DDDDr!r"r#r$r%r&r'r(c j# [RR5RS5n Sn SRU [ U5[ U5[ U5[ U5U "U5U "U5/5n USU3n [ R "5IShvN n U RXSS0S9IShvN nURS :Xa [S 5 SSS5IShvN gNJN2N !,IShvN (df  g=f![an[S [ U55 SnAgSnAff=f7f) z Invia un record al Google Sheet via Apps Script: Data, Tokens_prompt, Tokens_response_audio, Tokens_response_text, Tokens_total, Domanda, Risposta z%Y-%m-%d %H:%M:%ScbURSS5RSS5R5$)N, r)rvrw)rCs r2rq4GeminiHandler.send_to_google_sheet..s%!))C-55dC@FFHr1rz?sheet=Nz Content-Typez text/plain)urlcontentheadersu)✅ Riga inviata al Google Sheet (async).u+❌ Errore durante l'invio al Google Sheet:) rnowstrftimer*strhttpx AsyncClientpost status_coderr)rr!r"r#r$r%r&r'r(now_strclean csv_payloadrrresrRs r2r<"GeminiHandler.send_to_google_sheets ##'')223FGIhh    % & $ %   (O (O  gj\2 I((**f"KK><:X(??c)EF +**+***  I ?Q H H IsBD3DC'D C-6C)7C- D!C+"D&D3'D)C-+D-D3C6 4 DDD3D D0D+&D3+D00D3c8URR5 grn)rclear)rs r2 reset_historyGeminiHandler.reset_historys !r1c# UR5 UR(agSUlURHnUR5 M [R "URSS06IShvN UR R5(d<UR R5 UR R5(dM<URR5(d=URR5 URR5(dM<ggN![a Mlf=f![a gf=f7f)zU Cancella i singoli Task creati, poi svuota le due code (_raw_queue e _chunk_queue). NTreturn_exceptions) rrrcancelrgatherrempty get_nowaitrr)rrJs r2acloseGeminiHandler.acloses   <<  A HHJnndkkBTBBB//'')) **,//''))##))++ !!,,.##))++ C     sfA0E2D/3#ED11EE2E E-E1 D?;E>D??E E EEE client_idr WebSocketc X RU'grn)r)rrrs r2 register_wsGeminiHandler.register_wss#% i r1c<URRUS5 grn)rpop)rrs r2 unregister_wsGeminiHandler.unregister_wss )T*r1)rrrrrrrrrrrrrrrrrrrrrrrrN)Aoedei])r)g?g@)r )r(r)r*r+rrClientrintrtuplebytesrrrrrMrr?r]rRrr<rrrrr0r'r1r2rrs&GM1 u||1 1 UX1 f '5e#4 '%N/dNr U%eCHo8NU%r :%uS#X1G:%C:%n+^IsISITWIhkIEHI`cIsvIDGI@"@&S&k&+s+r1r session_idc# [U5n[R"5nUIShvN URUR 55nURUR 55nURUR 55nXEU/UlUb,U[U'[RR5Ul U7v UR5IShvN U(aU[;a[RU5 SSS5IShvN gNN=!UR5IShvN U(a!U[;a[RU5 fff=fNO!,IShvN (df  g=f7frn)rr TaskGroupr;rMrrrrrrrrr)rrhandlertgt1t2t3s r2connect_geminirsF#G    Br 0 .B 2 2 45B 5 5 78B b\GN%.5 +$,$5$5$<$<$>!M.." " "jO;##J/)rr$ #'.." " "jO;##J/DE>E$BD E$D*E$ E>E"E>E$E0D3 1.EE$"E>$E;*E- + E;7E>rn);__doc__rrrrnumpyr scipy.signalscipyrgooglergoogle.genai.typesrrrrrr r r r r rrrrrrrrrrenumrtypingr contextlibrpathlibre collectionsr itertoolsrrr__annotations__rr~r1rr!rrrrrrr'r1r2rs:|        ** /1c?*+05 2 LD 4,#,$s),`#@s +s +p003:00HYr1