Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »

Welcome to Software Development on Codidact!

Will you help us build our independent community of developers helping developers? We're small and trying to grow. We welcome questions about all aspects of software development, from design to code to QA and more. Got questions? Got answers? Got code you'd like someone to review? Please join us.

Posts by Franck Dernoncourt‭

34 posts
66%
+2 −0
Q&A "This model is not available on the selected Azure OpenAI Service resource." error, but I think it is. Why did I miss?

I've given up on that Azure UI, here's the Python code to do it. It requires a token generated via az account get-access-token. import json import requests new_capacity = 3 # Change this numbe...

posted 1y ago by Franck Dernoncourt‭

Answer
66%
+2 −0
Q&A When I write and run a prompt in Cursor IDE, what's passed in the context to the model (GPT/Claude/etc.)?

https://gist.github.com/sshh12/25ad2e40529b269a88b80e7cf1c38084 extracted the entire prompt for Cursor IDE: You are a powerful agentic AI coding assistant, powered by Claude 3.5 Sonnet. You operat...

posted 1y ago by Franck Dernoncourt‭

Answer
66%
+2 −0
Q&A When I write and run a prompt in Cursor IDE, what's passed in the context to the model (GPT/Claude/etc.)?

When I write and execute a prompt in Cursor IDE, what specific information is included in the context that gets sent to the underlying language model (such as GPT or Claude)? E.g., does it include ...

1 answer  ·  posted 1y ago by Franck Dernoncourt‭  ·  last activity 12mo ago by Alexei‭

Question cursor-ai
66%
+2 −0
Q&A Does the Rate limit (Tokens per minute) of an Azure OpenAI instance corresponds to the input tokens, the output tokens or the sum of both?

Does the Rate limit (Tokens per minute) of an Azure OpenAI instance corresponds to the input tokens, the output tokens or the sum of both? Crossposted at: https://serverfault.com/q/1176440/...

1 answer  ·  posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Franck Dernoncourt‭

Question azure azure-cognitive-services
66%
+2 −0
Q&A How can I resolve the 403 Forbidden error when deploying a fine-tuned GPT model in Azure via Python?

I follow Azure's tutorial on fine-tuning GPT. I'm stuck at the deployment phase. Code: # Deploy fine-tuned model import json import requests token = '[redacted]' subscription = '[redacted...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭

Question python azure
66%
+2 −0
Q&A Why does Azure Command-Line Interface (CLI) list no groups and no resources in my Azure account?

I have several resource groups and instances in my Azure account. Yet, the Azure Command-Line Interface (CLI) lists no groups and no resources in my Azure account: franck [ ~ ]$ az group list [] ...

1 answer  ·  posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Franck Dernoncourt‭

Question azure
66%
+2 −0
Q&A Why are model_q4.onnx and model_q4f16.onnx not 4 times smaller than model.onnx?

I see on https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct/tree/main/onnx: File Name Size model.onnx 654 MB model_fp16.onnx 327 MB model_q4.onnx 200 MB m...

1 answer  ·  posted 2y ago by Franck Dernoncourt‭  ·  last activity 2y ago by Derek Elkins‭

Question machine-learning onnx quantization language-model
60%
+1 −0
Q&A How can I run Flux2 inference on 2 GPUs?

I try to run Flux2 inference on 2 GPUs as follows: import torch from diffusers import Flux2Pipeline from accelerate import PartialState import argparse from pathlib import Path def main(): ...

0 answers  ·  posted 10mo ago by Franck Dernoncourt‭

Question python gpu huggingface-transformers
60%
+1 −0
Q&A How can I run the inference on the HunyuanImage-3.0 model?

I follow the instructions on https://github.com/Tencent-Hunyuan/HunyuanImage-3.0: conda create -y -n hunyuan312 python=3.12 conda activate hunyuan312 # 1. First install PyTorch (CUDA 12.8 Vers...

0 answers  ·  posted 11mo ago by Franck Dernoncourt‭  ·  edited 11mo ago by Franck Dernoncourt‭

Question python image-generation
60%
+1 −0
Q&A Import onnxruntime then load_dataset "causes ImportError: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found": why + how to fix?

Inversing the import order works: from datasets import load_dataset import onnxruntime as ort

posted 1y ago by Franck Dernoncourt‭

Answer
60%
+1 −0
Q&A Why would the tokenizer for encoder-decoder model for machine translation use bos_token_id == eos_token_id? How does it know when a sequence ends?

I see on this PyTorch model Helsinki-NLP/opus-mt-fr-en (HuggingFace), which is an encoder-decoder model for machine translation: "bos_token_id": 0, "eos_token_id": 0, in its config.json. ...

1 answer  ·  posted 1y ago by Franck Dernoncourt‭  ·  last activity 1y ago by Mithical‭

Question pytorch machine-translation tokenization encoder-decoder
60%
+1 −0
Q&A How can I export an encoder-decoder PyTorch model into a single ONNX file?

I converted the PyTorch model Helsinki-NLP/opus-mt-fr-en (HuggingFace), which is an encoder-decoder model for machine translation, to ONNX using this script: import os from optimum.onnxruntime im...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Franck Dernoncourt‭

Question python onnx pytorch machine-translation
60%
+1 −0
Meta What to do with GenAI tags?

None which have anything to do with programming I disagree, e.g.: a program may be about building an LLM. a program may call an LLM. a program could be partly be done with an LLM. so t...

posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Franck Dernoncourt‭

Answer
60%
+1 −0
Q&A Which model is Cursor IDE using when I specify a random model name?

Example: I specify a random model name some random name: Then I call it: Which model is Cursor IDE using when I specify a random model name? Cross-posted: https://stackoverflow.com/q/79...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Franck Dernoncourt‭

Question cursor-ai
57%
+2 −1
Q&A "google.auth.exceptions.RefreshError: Reauthentication is needed.": How can I extend the authentication time?

I use Gemini via CLI via Google Vertex AI. I keep getting google.auth.exceptions.RefreshError: Reauthentication is needed. Please run gcloud auth application-default login to reauthenticate. ...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭  ·  last activity 1y ago by Alexei‭

Question google-cloud-platform
57%
+2 −1
Q&A How shall I refer to the documents and the context in the prompt when using the Azure RAG-QA framework?

I use Azure OpenAI RAG-QA (aka "bring our data"): which I call via e.g.: import os import pprint from openai import AzureOpenAI #from azure.identity import DefaultAzureCredential, get_bear...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Franck Dernoncourt‭

Question azure azure-cognitive-services
50%
+0 −0
Q&A How can I update the capacity of a finetuned GPT model on Azure using Python?

How can I update the capacity of a finetuned GPT model on Azure using Python? The code wasn't working due to a bug on MSFT side. They fixed the bug last week, and as a result updating the capa...

posted 11mo ago by Franck Dernoncourt‭

Answer
50%
+0 −0
Q&A How can I use web search with GPT on Azure using Python?

Based on learn.microsoft.com (mirror 1; mirror 2), web search with GPT on Azure using Python is not supported yet: Not currently supported: The web search tool Image generation using m...

posted 12mo ago by Franck Dernoncourt‭

Answer
50%
+1 −1
Q&A How can I update the capacity of a finetuned GPT model on Azure using Python?

I want to update the capacity of a finetuned GPT model on Azure. How can I do so in Python? The following code used to work a few months ago (it used to take a few seconds to update the capacity) ...

1 answer  ·  posted 12mo ago by Franck Dernoncourt‭  ·  last activity 11mo ago by Franck Dernoncourt‭

Question python azure azure-cognitive-services gpt
50%
+0 −0
Q&A How can I save a plot in a file in PyCharm without changing the code?

How can I save a plot in a file in PyCharm without changing the code? I used plt.show(), so that the plot shows like this: But how can I save a plot in a file without changing the code? I don'...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Franck Dernoncourt‭

Question pycharm
50%
+0 −0
Q&A Can't run a Python file in PyCharm: why?

I closed the window containing the PyCharm project and reopened the project: it worked. I have no idea why it didn't work before reopening the PyCharm project. Very strange: I don't see what could ...

posted 1y ago by Franck Dernoncourt‭

Answer
50%
+0 −0
Q&A How can I deploy a fine-tuned GPT model in Azure via Python without using a token (e.g., using an endpoint key instead)?

I follow Azure's tutorial on fine-tuning GPT. I follow the deployment phase. Code: # Deploy fine-tuned model import json import requests token = '[redacted]' subscription = '[redacted]' ...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭  ·  edited 1y ago by Lundin‭

Question deployment azure-cognitive-services llm fine-tuning
50%
+0 −0
Q&A How can I automatically delete any deployment of a fine-tuned OpenAI model on Azure that hasn't been used in the past x hours? [duplicate]

How can I automatically delete any deployment of a fine-tuned OpenAI model on Azure that hasn't been used in the past x hours? I am aware of 15-day timeout. However, this is too long for me, as th...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭  ·  closed as duplicate 1y ago by ArtOfCode‭

Question azure azure-cognitive-services
50%
+0 −0
Q&A How can I automatically delete any deployment of a fine-tuned OpenAI model on Azure that hasn't been used in the past x hours?

How can I automatically delete any deployment of a fine-tuned OpenAI model on Azure that hasn't been used in the past x hours? I am aware of 15-day timeout. However, this is too long for me, as th...

0 answers  ·  posted 1y ago by Franck Dernoncourt‭

Question azure azure-cognitive-services
50%
+0 −0
Q&A How can I autocomplete variable names in prompts in Cursor?

It is currently not possible to autocomplete variable names in prompts in Cursor (source).

posted 1y ago by Franck Dernoncourt‭

Answer