← Back to changelog
Marc Klingen
September 23, 2024
Documentation now integrates with GitHub Discussions (Support and Feature Requests)
Marc KlingenSee previews of all commonly asked questions and feature requests for each page across the Langfuse documentation.
Preview of widget that’s included at the bottom of many documentation pages
n8n IntegrationFeature Request: Add Tagging Pipelines for Evaluation-Based TaggingAdding types for evals in LangfuseLaTex RenderingDatasets: Add selection of traces to a datasetMulti-user annotation capability in Score ConfigsFeature request: Lifecycle hooks in LangFuseRBAC: Restriction based on trace tags/metadataTrace Table: Ability to sort table by scoreMore filter on daily metricsAdd the ability to remove tags from traces via the SDK/APIPrompt Changelog ManagementSmartly integrate with prompt templating tools (like Jinja templating engine)Making prompt editing eye-pleasing and less error-prownPrompt Management: Metadata for Prompt VersionsExporting comments[Feature Request] API to Remove or Update Trace TagsAdd XML/tree viewer to playground and trace viewerIncrease character limit of comments in LangfuseEnh prompt management systemSupport image messages in the playgroundExtend RBAC to Include Teams and Refine Permissions for Prompt ManagementAutomatically Trace from PlaygroundReset LangfuseDecorator context to allow nested tracesDisable authentication in self-hosted deploymentsMulti-turn / session experiments in datasetsfeat: add support for SSR to allow runtime BASE_PATHCentralized API Key Management with Secret Store Integration (e.g. HashiCorp Vault)Allow sending events to multiple LF projects within one client appAnother glimpse into prompt management in LangFuseFeature Request: Enable Invites with `AUTH_DISABLE_SIGNUP` (or/and GitHub OAuth for a given organization)Getting prompts using LiteLLM syntaxAnnotation Queue: Display trace idEnable to use variable of prompt on evaluator.Sessions Table: Scores ColumnSort functionality in Users pageAdd new filters for the LLM as a Judge Evaluation (other scores and cost)Prompt Management: Deployment level viewPrompt Management: labels in prompt tableDoes LangFuse support a (declarative) plugin architecture?More Granular Target Objects for Langfuse EvaluatorsEvaluator CRUD in UI and APISpecify data masking on decorator itselfExport dataset run tableCustomizable data mask (input/output, observation names, observation type)Add support for more complex Jinja constructsLinking ChatPromptTemplate to Multiple Promptsfeat: support adding trace tags in annotation queue viewFeat: De-dupe and show info when adding the same trace/observation to an annotation queue multiple timesDiff support for dataset runs viewCreate Support for gemini models in playgroundDuplicate a template prompt to start a new prompt with all the boilerplate preparedSDK-Python: Get all prompts from LangfuseSDK ClientSupport custom aggregated queries through the UIAlerts based on metrics (cost, evaluation, user-feedback), trigger webhook/email/slack/...Change AWS access pattern for Bedrock LLM usage, assume roleSupport for Atlassian OAuth-ProviderAsync support for data masking in JS/TS SDKAdd ability to export and import evaluators between projectsDecorator: disable tracing at the decorated function levelAdd keyword highlighting and color codingfeat: Folder structure for dataset organisationModel-based evaluations triggered by observationsSupport for Custom SSO Without AUTH_CUSTOM_CLIENT_SECRET and Incorrect Profile MappingAllow prompt editing without creating new version (draft mode)feat: user consumption broken down by modelTrace -> Playground: Populate variable fields to make input iteration easier.add gpt-4o-2024-08-06 model to langfuse models listEnsure prompt validation when attaching prompts to generationsSupport for OpenAI's cached input tokenspython generator request - return valuesScores: Conditional AnnotationAnnotation Queues: define optional/mandatory score configs by queueScores: support for recording multiple choice selection as score valuePrompts: ability to share prompt or playground sessionDistinguishing various stepsFilter by status in dataset items tableAdd generic types for prompt variables in the sdk clients, e.g. `langfuse.getPrompt<{input: string}>("prompt name")`Add image type with image_url for vision apoVersioning/edit of Evaluator ConfigurationMeasure time to last generated tokenSupport annotation role permission to only access Annotation Queue featureOpenAI integration support for realtime apiDsPY type optimization functionalityIntergrate with RagflowGet Observation IDs of sub chains when using @observe decorator combined with Langchainobserve context managerTerminal version of Langfuse (Langfuse CLI)Evalution of a prompt by a LLMDashboard: Add time to first token chart (ttft)Table sorting and filtering in database runsUser Aliasesfeat: edit custom model definitionsDashboard: split prompt/completion/total tokensMetrics API to support the OpenMetrics formatAsynchronous Langfuse Client.Add SCIM support for user/role/identity managementVector search for datasets for few-shot promptingSampling for JS/TS SDKs and integrationsAdd saved filters configShow prompt-level aggregate metrics on the prompts tableField-level selection for input/output filtering in decorator instead of using update_current_observation/tracefeat: organization level dashboardTextGrad integrationChart: usage/metrics grouped by tagsDashboard: add chart for unique users (MAU/WAU/DAU)Playground: Move messages / add messages in-between othersWhy not extend observeOpenAI to support message-level user id?Filtering dataset itemsSupport export for Dataset ItemsPrompt label promotion via api/sdk3rd option for "sharing" traces publiclyOnly use traces in the dataset to render score columnsSource code versioning and automatic statistics caluclation from scoresAdd graph view for LangGraph tracesMask / redact PII from traces logged to langfuseMake compile and get_langchain_prompt interoperable when using a prompt from langfuse in langchainBetter mustache/jinja support in langfuse playgroundAdd fine-grained filtering options in python `fetch_traces` API to match web UIAllow LangchainCallbackHandler to specify custom input/output?Promptfoo integrationDefault closed dropdown view in trace detailsDashboard: TPM chartGroup Similar or Consecutive TracesMore customization in graphs and dashboard panelsLLM Based Evaluation - more control with mapping a variable e.g. {{query}}, {{ground_truth}} etc inside of Input/Output/Metadata observationSupport for Firebase Genkito1-preview and o1-mini supportAdd Notification for / in Comments ObjectsExtend Searchability (through filter) for Comments ObjectsFilter by error in sub spanDeleting old, unused tags or making them unseen if weren't used in the chosen time window.SDK-JS: Allow to delete one or more traceRetrieve the trace by metdataInclude metrics and scores in getDatasetRun / `GET /api/public/datasets/{datasetName}/runs/{runName}`Custom ThemesComment APIIntegration with LangChain4jNeed to retain the old evaluation history results, including input and all ground truthAdd organization / project / user / API key management APIAbility to export all traces/sessions/scores from langfuse and import back to another langfuse instanceSupport for Selecting Specific Paths from JSON Objects in Evaluation PromptsTrace Logprobs from OpenAI models(ui) Ability to hide "scores" columnDataset run description and metadata should not be fixed on the pageSupport for exporting traces to CSV/JSONOptionally set timestamp when creating a scoreSetting trace ID and parent observation ID with Python decorator SDKLog only metadataThe display time on the x-axis of the chart in the Dashboard shows only the date, without hours, minutes, and seconds.Support Tool Calls / Functions in PlaygroundAdd the ability to search by message words in traces and scoresDiff of prompt versionsThe LangchainCallbackHandler supports statistical delay of the first tokenRequest Role elevation from Langfuse UIImprove RBACAdd "image_url" to Langfuse Prompt types.Support for OpenAI.client.chat.completions.with_raw_responseBeing able to link Prompts with Traces when using the LangChain integrationImplement dataset removal methodTrack openai token usage from stream_options instead of tokenizing the response server-sidePre-defined user accessSupports filter string using regular expression matchingSupport for more modalities and base64 contentFilter Span events in dashboardClaude/openai/google prompt cachingUnexpected event format when using `ibm-watsonx-ai` with LangChain extensionfetch all users via sdk/apiTag based usageAuto-patching Langchain to include Langfuse callback handlerFeature: Add CAS (and maybe SAML) as a authentication methodAdding access to User's sessions directlyCompare two dataset runs side by sidefeat (ui): Collapse sidebar by defaultMake langfuse deployable to AWS Lambdacustom base path deploymentsAdd Bedrock Guardrails to the LLM Security documentationAdd AWS as a deployment option in the documentationFeat (ui): Move columnsFeat: Allow not sorting tagsNeed support for ChatOCIGenAINeed API endpoints to add projects and usersCould you make the Prompt label 36 char long?Enable setting a label to an existing prompt version via the api/sdk.Enable list_prompts/search_prompts using clientAdd support for custom serialization of observation fieldsAdd clickable link to the 'release' kwargs in a Trace - this will route to the documentations/change log of that release/versionSupport Exporting LangSmith Run Traces into Langfuse!A new configuration env variable for custom URL prefixReturning prompts from expired cache may be disabled using a boolean argumentLazy fallback for get_promptSet variables in playground from datasetComment thread on TracesSession-level scoresAdd note on each prompt versionFeature request [UI]: Remember column selection PER project in Traces viewSupport JSON messages in prompt managementDeleting user's traces via API to be GDPR compliantSchemad or structured configuration for promptA transparent modeLangfuse batch prompts api should return prompt configs as wellVisualisation of graph executionI want to say something about user feedbackPrompts are supported for exportWeb page request is a little slow, whether to consider using golang to reconstructAdd ability to add name or label to a Langfuse API keyTrack Openai Assistant API costsAdd tool / function calling and tool messages to Prompt ManagementInbuild langfuse tracing.DSPy tracingFeat: Ability to change curreny for model usage costs.Conditional Trace Content/Message submissionDetailed and Interactive Plot Visualization like WandBLog prob on LangfusePrompt Cataloguing and prompt githubIf Data/Metadata given to Langfuse SDK that exceeds Langfuse's limit, log/throw/emit Stack TraceInclude request's `tools` configuration in OpenAI LLM callsSimple graphs and metrics for scores and evaluationsfeat: Track Exceptions while using DecoratorsFeature Request: Sidebar Display for Trace Details in Dataset RunsScoring dataset runs, e.g. precision, recall, f-valueHow can we see traces of MULTIMODAL llms over langfuse ?Support OpenTelemetry-based instrumentation (traceloop openllmetry and others)Enable Langfuse can expose metrics in Prometheus formatUse Langchain LCEL + Langserve + run time user_id/session_idEasy token price estimates for 400+ LLMsAdd contextmanager support to python decoratorAdding userId / author to score (custom metadata)Export to CSV feature in the TracesExpand all json-views of Dataset items etc.Bedrock provider when using llamaindexProject members management via public APIAdd string data type in score configSupport for Custom Base URL Prefix in Langfuse (nextjs basepath)Add ARM64 docker imageImplement Duplication Check for Prompt Versions in LangfuseNumber of times a prompt was fetchedAllow for custom OAuth scopes when self-hosingSBS Markdown mode for dataset runsAdd view mode to SettingsSupport SAML login protocolBring Langfuse to Cloud MarketplacesSaving a filterPendo integration[Dashboard] Update Scores Chart to include number of scores on secondary y axisType of input and output of each span visible in the UILangfuse retention settingsTracing integration with unify.aiAdd Langchain Support to Prompt ManagementMonitoring Costs and Traces generated by RAGASnew chart in dashboard for booleans metricsMessagesPlaceholder in "Create New Prompt" panelEnhance data in daily metrics api endpointAbility to add comments to versions of prompts ("commit message")Timeline/graph visualization for tracesTerraform Provider for internal Langfuse configurationsupport query prompt via prompt idSupport for SDK entry-point wrapper around async REST API clientSupport querying Users (GET) to support analytics pipeline solutionsPrompt version only create when differentclickhouse supportExport to data warehouses (BigQuery etc)Proposal: Add Support for Uploading Dataset Items via UIPhidata supportFeature Request: Tracing Sampling Rate Configuration for Langfusefeat: Adding AWS Cognito AuthenticationMarkdown Rendering Optionfeat: inject langfuse info into langchain metadataAdding prompt tags via Python SDK (or other code based interactions)Save playground conversation to a datasetSupport multiple prompts attached to a generation.Show explicit error when viewing a project that doesn't existRequesting official support OpenAI's new gpt-4o modelSupport instrumentation through openllmetryIntroduce the concept of "sub-prompt" to improve prompt reusabilityAdd number of 'successful request' to traces list viewAsk for a import/export on prompt management pageGitlab Auth ProviderAdd batch actions to tracesUpload datasets via UIAPI/UI to delete dataset items and runsIs it possible integrate Langfuse with Microsoft Copilot Studio?Openai: Support IO capture when streaming function / tool callLooking into allowing more customization of the tableLangchain integration ImprovementsRetrieve prompts based on versioning rather than times for cachingDelete Sessionlinking prompts with tracing in langchain integrationAdd integration with evaluation frameworksSupport Linking Execution Trace to DatasetItem without Fetching Entire DatasetPlatform User roles to allow or disable project creation[oauth] Keycloak provider supportSupport GigaChat model from LangChainDecorator should also be able to return JSON or Dictionary objectHaving a session_with_user clientChange `/api/chatCompletion` to be a standard OpenAI proxy on `/api/v1/chat/completions`?Auth using Microsoft Entra IDAdd a metrics endpoint for PrometheusProvide an integration with Matomo Analytics so as for PosthogAdd command r/command r plus via Azure MarketplaceUser-level dashboardRequest chart of min/avg/max input/output tokensLimit new user registrationfeature for python client：get traces by scoreLog for Function CallingSSO: CognitoPromptClient: Support mustache type export to langchainNew REST API endpoint to get all promptsRequest chart of the generation speed of tokens (tokens/s)annotation of traces in langfuse console?feat: Prompt API Search (by tags)Is it possible to support Dify?feat: Add `TRACE_EVENTS` flagAdd support for ZITADEL OIDCWebhook to trigger CI/CD pipeline when new prompt version is createdReview feature for prompt deploymentAPI for custom model <> token usage pricingExport & import for prompts, copy between projectsRead-only prompt keys?Ability to run langfuse in tests automatically without manual involvement"Task" and "Bot" core abstractionsPrompt Composabilityfeat: Function Calling Under OpenAI FormatGroq - MixtralVertexAI support[Feature] Add a score value filterDSPY integrationLangchainCallbackHandler httpx_client not accessibleDisable events loggingRequest for Integration of Mistral Models into LangfuseManaging EmbeddingsLangfuse Trace with OpenAI AssistantsComment column can have any name the user chooses, there could be multiple comment columns per metricMake Langfuse switchableAdd total filtered Generations to UILoose prisma datasource db provider.Langfuse images for arm64 (mac silicon, some cloud vms)Add a time based filter optionIntegration with Langserveallow to delete sessionsToggle collection of traces on a per-trace basisAdd a "correction" field on the user feedback infoTrace Latencies line chart pleaseWhat standardized dataset formats are people using?Reorder columns in tablesAdding a "Select all" button to tablesHide prompts/completions (privacy)Enhancements for Langfuse User Sign-Up Controlbug: Not allowing to limit Azure AD authentication for selected users in same tenentAggregate cost per spanSupport parsing LLM model for ChatOllamaAdd LLamaIndexTS exampleAdd a retention window for unnecessary dataSupport for Langchain ChatAnthropicAdding cost to the datasets tablesMore prompt environments/tags instead of just `active`Log used prompt on generations when using Langchain[TS] Generating through OpenAI SDK directlyAllow Project-Specific Default Time RangesConsider adding support for DSPySupport DSPyIntegration: LlamaIndex JS/TSAdd filtering by errorsAdd Audit Logging System to Worker TasksPossible with different units for input and outputChatML/ChatMessage Prompt TemplatesDashboard for all projects of an organizationAdd Haystack integrationExport to S3Export to BigQueryAdding support for async Langchain methodsAdd Images in TracingRequest to add 75 percentile under Model latency section as shown in image belowLLM PlaygroundLooking for users (that are migrating off of something) to co-build Langfuse integration withPossible to set timestamp when creating traceDedicated user object which can include groups/teams and other attributesAPI to delete scoresDisplay all traces within a session[Simple Feature/WebUI] Adding a button to hide the sidebarPrioritize traces captured from LangGraph by relevancePulling prompt/completions via APIPrompt version comments"Git diff" view between two prompt versionsAbility to post-process generation data[Python SDK] Link prompt to OpenAI Chat Completion directlyUse JWTs for API private keyAdd LLM call duration on session and trace tableFlowise: Allow adding metadata in API call to populate Langfuse trace metadataFlowise: Allow Langfuse traceId to be set or passed on with API responseModel costs in terms of energy for self hosted models (or cloud hosted)Use proper logger for backend API to make it configurableAPI Examples for GenerationsAllow sharing traces as a self contained HTML file via presigned S3 URLAbility to query entities from SDKSubscribe to Langfuse Events via WebhooksPeriodic reports (email or slack)Add `Embedding` observation typeLeveraging Azure OpenAI Diagnostic Settings?Configurable dashboardsAdd new integration: LLM ProxyDecorator-based integration with Langfuseshould work with OpenAI-compatible self-hosted endpointsUsers should be able to pass metadata and tags via `overrideConfig` when using the Flowise integrationInferring cost of trace from metadata field if optionally providedfiltering sessions with metadataEnable Collaboration Platforms for Project MembersSupporting OpenAI VisionComments on objects across the Langfuse UISupport alternative databases next to Postgres, e.g. MySQLFlowise - OpenAI Assistant cost trackingLatency metrics - Time to first token, Tokens per secondLLM calls captured via Langchain integration should match what’s sent to the LLMImprove integration with flowiseDark modeFull-text search on trace/observation/generation input/outputDownload dashboard detailsSupport secret in docker composegeneration usage should accept a list of dict for async generationImprove exception handling and type safety in python SDKFeature: API should give User-TokensAdd prompt.to_langchain() to get a Langchain Prompt Templatefeat(ui): Dashboard filter and highlightIntegration: Node.js/Typescript OpenAI SDKLlamaIndex integration (Python)Admin API: projects, api keys, user managementVersioning of docsDatasets: Diff of output and expected outputfeat: Publish arm64 compatible docker imagesOpenAI SDK wrapper for JSTracing for multiple iterations and tool callingDoes Langfuse tracing work in Vercel edge functions?How to completely discard image with new multi-modal system?Error while migrating shemaSilent failure when attempting adding scores to traceNot able to see tracesLangchain with ChatVertexAI: Image/Audio Input Not Displayed in Dashboard with Multi-Modal TracesIs downgrade available for self-hosted version?Unexpected error occurredTracing of Async Tasks in Agentic WorkflowSend metrics to ELKRequest for Simplified Custom `trace_id` Implementation in `CallbackHandler` for LangServeLangchain//Langgraph prompt linkslower than expected langfuse_context.update_current_observation operation?Langfuse returning a internal server error message sometimesUpdate prompt label programaticallyPreventing Input and Output Capture for GENERATION span in Langfusewhy setup trace is showing SETUP Tracing Pending always and Trace doesn't show in dashboardDisable tracing for certain callsCustom trace properties in AsyncOpenAILangfuse overwriting ingested usage for gpt-4o-mini models & incorrect inferred usage for low-detail image dataWhy my langgrpahjs agent can't show tokenHow/which environment var do I need to set to get OAuth2.0 authentication flow?Is there a way to keep database connections open longer?Tokenizer config for Qwen 2.5 models[Generations]: Support n parameterIs there a way to get process to exit on DB connection errors when rotating database passwords?How to update a score?TypeError: LangfuseTracer.trace() got an unexpected keyword argument 'parent_span'Tenant based prompt management ?LangGraph traces cause self-hosted instance to hangBlock strangers from signing in to your appCan we use Langfuse without any Authentication enabled?Can I evaluate Span using the External Evaluation Pipeline?ERROR - An error occurred: 'function' object is not subscriptableHow can I implement a knowledge base and multi-turn file dialogue with pip deployment?! How does this “history” work?Configure LangFuse Project within CallbackHandlerOpenwebui and langfuseConfiguring loggingLangfuse User Management with Custom OauthHow to prevent strangers from creating an account on your appDoes it make sense to use multiple api-keysAuthentication not working?Langfuse deployment issue on k8Should the Langfuse classs initialization be cached (does it do any I/O on init?) ?"Custom" traces not creating when Next.js Vercel instrumentation is on.When running in relatively high amount of concurrent requests we start getting: "API error occurred: Service unavailable." from Langfuse serverSSL: CERTIFICATE_VERIFY_FAILED error when access the self hosted langfuse from the codeBlob is not defined for Node 16Cloudron packaging issue with Prisma clientCan you use the app without OAuth?Pending Badge Stuck on Setup Tracing StepgetPromptStateless received 403 error when using `LangfuseWeb` SDKMissing scores after pushing scores to LangfuseFor which kinds of data is `ENCRYPTION_KEY` used?How to set environment variables for custom oauth2.0 sso？Langfuse.create_prompt() got an unexpected keyword argument 'version'Is there a way to clear trace data in batch?Improvements of Langfuse-Haystack integrationPostgres version mismatch when upgrading langfuse locallyRate limit exceed using Langfuse Python SDKIf I use Anthropic Claude component in Langflow, the trace data in Langfuse is all nullAllow injection of generation context into evaluation promptHow to fetch the output and input tokens of a trace via API?Sometimes traces lack metadata completelyhow to add invoked langchain tool names as tags or as metadataAzure AD auth: OAUTH_PARSE_PROFILE_ERRORI cant quite tell if i'm doing the parent span correctly. The trace is appearing but not associated to the SessionNo token information in observation of LLM runSelf host Langfuse not working - column `t6.cloud_config` does not existLangfuse Tracing not showing up on UIRequest Timeout for DashboardMonitoring self-hosted langfuse.Open AI Python SDK - 'OpenAI' object has no attribute 'langfuse_auth_check'Traces: Link a trace to multiple sessionsHow do I user wise "Total Token" counts via API or via python, As I want to track which user is consuming how much tokensTo use Gemini on playgroundTraces and events not going through to Langfuse server even though they're generatingInsert API Keys in databaseWeird behaviour of metric values and their reasoningFilter Categorical Score ValuesManually setting up Langchain Callback handler with explicit values doesn't configure langfuse client in decorator approachHow to use prompt management with litellm's integration with langfuse?Annotation Queues and Session IDs and Datasets and LLM SecurityObserve decorator not working with custom langchain model & custom langfuse callback handlerError when trying to upgrade my langfuse deploymentLatency and total cost for runs are not computedBest practices for tracing an app with history and tool usageHow to create an eval config for prompts using python api?Monitoring for multi agent systems (OpenWebUI)Is it possible to use tools calling and structured output in the Prompts UI and Playground?How to delete a Session?Llamaindex Workflow does't work with Instrumentation ModuleCan I use Amazon Bedrock for Langfuse Evals?Langfuse / Langflow not intergratingLangfuse not tracing code from my VM (server)Docs for K8s deploymentsCannot Sign In or Sign Up to Local Langfuse InstanceSign in and Sign up button is greyed outSign In Button Remains Disabled When Logging in with Email/Password on Langfuse Self-HostedFailing with internal server error when trying to add score to a traceSet trace_id in Langchain CallbackHandlerAutomated provisioning of default resources in self hostingUnauthorizedError: No authorization header After Switching to Headless InitializationToken Cost using OpenRouterLink 2 tracesUpdate a traceHow to track DSPy call within LanggraphLlamaIndex traces groupingcreate api keys pair using some method or apiHow to Set Custom Trace ID with a Decorator and Include langfuse_observation_id?error ❌ tRPC failed on public.checkUpdate: Failed to fetch or json parse the latest releases Failed to fetch or json parse the latest releasesis it possible to assign a label to an existing prompt via API/SDK ?Applying database migrations failed. This is mostly caused by the database being unavailableis it open source or not?Langfuse not logging costs on Vertex AI gemini-1.5-flash-002.Not possible to delete prompts programmatically, (langfuse python library or api)Unable to fetch prompts without production labelMissing input/output on trace when using openai js integrationBind all multiple hierarchical call against session-id instead of opening multiple threadsHow to avoid memory leaks due to LangchainCallbackHandler while using userId and sessionIdHow to provide a TLS Cert for PGSQL cloud connection in Langfuse docker container?LangFuse Low Level SDK does not render images by passing the linkraise exception when handle_span_eventsHow to get costs associated with an API call / user?How to run langfuse locally while using a hosted databasehow to set user_id or session_id in trace?Langfuse observation for openai embeddings methodRight way to migrate langfuse deployed on K8s within an AWS accountLangfuse is inconsistently generating span latencies table in traces greater than 36K entiriesAsync version of Langfuse.get_promptHelp setting up GCP host (cloudbuild or console)Configuring Evaluation with "Correctness" Template & Python Code InvocationModule not found: Can't resolve '@langfuse'tokens and usage costSelf-Host evaluation featurenot able to track entire request end to end in langchain + langfuseFeedback for “Langfuse Documentation”Hey want to change the Eval Templates name, can we do it from UIHow to use langfuse with LangGraph StudioSession ids for Langservehow to pass custom user managed model name to calculate the cost via langchainAutomated Prompt Management across EnvironmentsDataSet Scores are not being displayedbug: cost usage are not getting captured automatically from llm responseUnderstanding pricing model (self-hosting vs cloud serving) from security perspectivepython decorator grouping in trace when using FastAPI Server Sent Events and Langraph + custom functionVercel AI SDK and Svelte. How to push traces intermittently back to langfuseWhen using callbacks, the langfuse_context.update_current_trace method does not function properly.change of data regionEvaluation config setup related queryWhat does `version` means when ingesting trace?Get all the generations, events, etc. under Traceusage pattern for new llamaindex integrationTracing ChatGoogleGenerativeAI calls in langchain doesn't return usage metadataGeneration does not come under @observe traceLangfuse 2.74.0 integration with Flowise 2.0.5How to set SMTP_CONNECTION_URL and reset password?Dockerfile of langfuse/langfuse:2 imageTime to first token is not populating in trace detail or generations viewPulling prompts by tag?Deployment into AzureHow to change the Level to ERROR when there is an error in SPAN?Support for configuring SMTP email at project levelExample GenAI bot with guardrails[Question] using langfuse with llama_indexNon-langchain generation nested within LangGraph executionTracing directly to queue instead of http apiHow to resolve memory leak when integrating Langfuse with LangChainDuplicate usage data in observation api endpoint responseTime to first token queryLocally hosted PrivateGPT + pgpt_python + LangfuseUnit of token count for cost analysishow to return trace_id in openai completion response when using langfuse as a proxy in litellm?Span created with Langchain not showing up in traces.Change port database in file docker-compose.ymlChange port connection in docker composeHow to append current trace when calling function second time?How to update an eventHow to change the level of a trace?ERROR:langfuse:status_code: 404, body: {'message': 'Trace not found within authorized project', 'error': 'LangfuseNotFoundError'}Does langfuse trace parallel api calls? I tried a sample with parallel call but it didn't traced.Self-hosted Langfuse running as a Google cloud service not showing tracesUsing the API to record traces from multiple platforms?Langfuse observeOpenAI not logging generations using new zodResponseFormat.How run Langfuse evaluations over specifics spans?LangFuse not logging LlamaIndex eventsUpdateRoot in the callback handler seems not workIssue: Integration of Langfuse with DSPy Framework - Zero Values for Cost and Token UsagePraise for the Langfuse library! 🚀No space left on device db errorDynamic prompt generationUnable to update generation span after LLM invocationSelf-hosted (Railway) Authorization error (401) while connecting to hostContinue trace on Celery worker with observe decoratorHow do i register the token count and cost for observe decoratorMissing evaluation metricsAbility to upload Cost and Usage metrics in Langfuse for Gemini Models from LlamaIndexDeployment on K8sHow to ignore inputs when using LangChain?Langgraph with langfuseUsing langfuse without saving prompscannot execute INSERT in a read-only transactionDisable tracing of input and output for nested elements with in a chain.Support for adding traces/observations/sessions/events/spans/generations related logging to LF via APICannot connect prompt to trace when using Langchain AzureChatOpenaihow to customize trace id when using callback handler in langchain integrationAdding Scores to langfuse with difyHow to add a function to current trace instead of seperate since it's outside lcel chain?Weird Output for scores when using fetch_traces()Add input Price and Output price for gemini-1.5-pro and gemini-1.5-flash in ModelsOverall projects dashboard?[Errno 111] Connection refused when connecting to langfuse within docker composeMigrate a local deployment of langfuse from one computer to anotherExperiments running but inputs and outputs of LLM are not linked to dashboardhow to embed langfuse dashboard in other toolHow to use prompt management with openai JS?Update metadata when using OpenAI JS IntegrationCan't set trace params e.g session_id when using with llhama_indexMethod to update prompt template for Langserve use caseCost of embedding in langfuseGetting all traces logged in a timerange for custom scoringCost of embeddingGetting issue with local setupAccess observation id in langchain runnableTrying to work with llama3 in Azure using AzureMLChatOnlineEndpoint but no cost showing upsome tests failed for langfuse-jsAUTH AZURE AD returns AADSTS9002325: Proof Key for Code Exchange is required for cross-origin authorization code redemption.Trying to understand why in Langfuse Trace under Stream Completion I get this output:Modify trace after getting response from OpenAILangFuse UI doesn't show all traces despite debug logging saying that all are sent to the serverLangfuse was not able to parse the LLM modelCan't see any traces or logs when running Langfuse locally.Not recording llamaindex response. Please helpAdd label to prompt from Langfuse UILink Prompt & Trace with langchain CallbackHandler[Migration] Auto-migration DB error when upgrade langfuse versionCustomize Langchain callback handler to add spans to existing traces created by separate thread/processnot serializable object of type: LangfuseResponseGeneratorSyncChain two promptsCan you use internal Kubernetes DNS to receive traffic from other Kubernetes workloads?Getting trace id out of a langchain runnableCan RBAC Role Assignment be done using Azure AD SSO token?llamaindex: function_call does not generate subspans for a custom AsyncBaseTool classThere are no evaluation component in the 2.50 versionUnable to get hello world program working due to incorrect public key / host2 traces generated instead of 1How to clean the langfuse cache data periodically?Model Cost does not show upPossibilities for authHow does one replace values for a ChatPromptTemplate for LangchainTime to first token?How to reuse callback handler in langchain integration?Auth0 not workingConnect Prompt ID to GENERATIONS when integrate Langfuse in LangChain.__root__ -> items -> 0 -> datasetName field required (type=value_error.missing)get_langchain_handler() alwasy start from trace root.Customize LangChain Integration.Need help on syntax for editing project rolesUnable to login with SSOLatency (Avg) showing 0 for dataset runsEvaluations Not Available in Self-Hosted Version?Careers link on HN is brokenToken cost is counted even if langchains LLM cache is utilizedHability to store pre defined initial messageDeleting Duplicate Items in a DatasetWrong model for billingError Encountered During Migration for Applying Newly Supported Models to Existing DataWill Playground be available for self-hosted?Error on Local Deployment: "Evals available in cloud only" when Adding LLM API KeyDoes langfuse uses any Postgres-only features?Exception("parent run not found")Availability of evals when self-hostingStarting a demo from JS SDK and local running Langfuse, but cannot create init trace currentlyCustom name of Span when using Langchain handler instead of RunnableSequenceNot able to add dataset itemLangfuse in PHP. Which are the minimum functions needed to implement?How to get trace data with langfuse-langchain in JS/TS?trace doesn't work with .batch handler on langserveget_prompt function failed in langfuse-python 2.28.3How to utilize a dataset w/ typescript and langchain integrationDevOps: What is the best way to create separate Langfuse instances in different environments: Dev, Test, QA, Prod?How to communicate trace-id between backend and frontend ? (langchain+langserve integration)Not able to build docker image from web/DockerfileSimple Prompt -> LLM error with Usage Object?Can't see traces in the webUI if callback_handler passed to LLM init constructorAlter generation names with LangChain integrationhow to check only output tokens and models costs related to only output tokens?Deploy to herokuNeed help with resolving long runtimes when Langfuse tracing is enabledHow to limit the number of tracesFlowise 1.6.5 can not TraceHow to get generations and scores in the same trace when using OpenAI sdk or other toolsInvalid public keyCookies not allowedRun Langchain Evaluations on data in Langfuse , Why is the prompt not considered, and could this lead to evaluation flaws?Scoring a trace after the LLM chain returnsOkta auth got `read ECONNRESET`Trace input is null when passing in nodes, or Documents with transformations to VectorStoreIndex constructorTracing and Session support on Integrations like LiteLLM Proxy and others and Is LangFuse logging a background process?Aggregated project from multiple langfuse serversHow to add default user and project to self-hosted docker?[Alerts] Connect to SlackUpdate/delete score using python sdk502-Bad Requestbug: Potential bug with AzureAD auth setupLangfuse session ID when using ChainlitLinking dataset run items with existing callback handlerAdd UserID and Feedback when using LlamaIndex Integrationlangfuse.api.resources.commons.errors.not_found_error.NotFoundError: status_code: 404, body: {'message': 'Observation not found'}Hybrid usage Langfuse among OpenAI calls as well LangchainDatasets list / by idRunning Langfuse in KubernetesMatch LLMs from AWS Bedrock to added model definitionLangfuse flush() taking a long time and hangsHow to fix error when running docs app demo chatRun items not appearing when linking to a trace and not a span or a generationHow do I add custom LLM APIs to the Langfuse UI?Applying database migrations failed. This is mostly caused by the database being unavailable.Openai and null traces for input/output/metadataIncompatibility between openllmetry and langfuse OpenAI wrapperDoes Langfuse integrate with LiteLLM Proxy Server?Do you need a helm chart of langfuse?When referencing the local langfuse in the langserve code, an error occurs：“ImportError: cannot import name 'ChatDeepInfra' from 'langchain_community.chat_models...”Can Langfuse be used to record the records of ConversationChain in LangChain?What is the shadow database needed for?Unable to set session id or other CallbackHandler parameters when passing trace client in langchain sdkHow to set tags when using the Langchain Callback handlerOllama token countsTrace of custom classes gives nondescriptive infoHow to pass span id to OpenAI `chat.completions.create`Sessions vs Traces?feat: support for custom httpx.clientWhere to log request and response headers of generations? (litellm)Best way to flush LF in Next.js?Sentry for self-hosted?How can I get the trace_id in langfuse.openai.OpenAI?AWS SES IAM PolicyWAF Rules for self-hostedScaling / Parallelism / Concurrency safe?Building Docker container without database connection?If we use cloud services, when we migrate to our own host later, do all the above data support export?Cannot see Add to Dataset button in the UISan Francisco: Langfuse User Meetup, Thursday Oct. 17thLangfuse Community Session: September 18th 2024Ask me Anything with MarcLangfuse now integrates with Dify.AI🪢 Langfuse is HiringIntroducing FAQsNew langfuse integration with Pythonic LLM library MirascopeUpcoming architecture changes for Langfuse 3.0 (self-hosted)Support: We're live on Product Hunt today!Langfuse Launch Week #1Langfuse Roadmap[Docs 2.0] -- Help us improve our documentationPrompt Management: Caching on SDK-levelv2.0.0: Custom model usage and cost trackingMoving Feature Requests & Q&A to GitHub Discussions
- 8votesConnect Prompt ID to GENERATIONS when integrate Langfuse in LangChain.hdp173•5/28/2024•1Resolved
- 5votesToken cost is counted even if langchains LLM cache is utilizedarthurGrigo•5/20/2024•1Resolved
- 5votesWill Playground be available for self-hosted?sabatesduran•5/16/2024•2Resolved
- 5votesUpdate/delete score using python sdkmsanand•3/25/2024•1Resolved
- 4votesAdd input Price and Output price for gemini-1.5-pro and gemini-1.5-flash in Modelsfjeanchar•7/10/2024•1
- 4votesAccess observation id in langchain runnablesnikch•6/26/2024•1
- 4votesCan RBAC Role Assignment be done using Azure AD SSO token?joshwright10•6/13/2024•2
Discussions last updated: 11/25/2024, 6:06:20 AM (4898 hours ago)
GitHub Discussions has long been the best place to ask questions and provide feedback about Langfuse. It has helped scale support and foster collaboration on new features. However, finding relevant discussions has been challenging, especially for those interested in specific topics or features.
We have now added a preview of all relevant GitHub discussion posts to many pages[1] in the Langfuse Documentation, this is based on the labels that are set on the discussion posts. We will continue to roll this out to more pages over the next few weeks.
We were inspired by the PostHog documentation, which features a similar widget for discovering answers to common questions and voting on roadmap items. Instead of creating our own discussion forum though, we chose to just index GitHub Discussions, as it is already well established in the Langfuse community.
Let us know what you think!
[1] Examples: Roadmap, LLM Playground, Prompt Management, Decorator-based integration for Python, Langchain Integration, Integration Overview
Last updated on