test(core): add tests for approximate token counting with multimodal messages
#34898Comparing
lewisjwhitehill:add-token-counting-multimodal-tests
(be5736d
) withmaster
(f8d5a50
)0%
- Untouched
- 13
- Skipped
- 21
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
34 total
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py+1%
472.3 ms469.2 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py0%
174 ms173.5 ms
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py0%
23.7 ms23.7 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py0%
189.2 ms188.9 ms
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py0%
263.8 ms263.6 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py0%
505.3 ms506.6 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py0%
450.9 ms452.3 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py-1%
524.1 ms527.4 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py-1%
543.4 ms547.2 ms
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py-1%
546.2 ms550.3 ms
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py-1%
637.6 ms646.5 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py-1%
608.7 ms617.7 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py-2%
500.6 ms509.9 ms
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandardSkipped
1.6 s*
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.pySkipped
316.9 µs*
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllamaSkipped
1.6 s*
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnitSkipped
1.6 s*
test_nomic_embeddings_init_time
libs/partners/nomic/tests/unit_tests/test_standard.pySkipped
1.5 ms*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandardSkipped
804.2 µs*
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandardSkipped
32 ms*
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.pySkipped
2.3 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandardSkipped
1.1 s*
test_init_time
libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
12.2 ms*
test_stream_time
libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponsesSkipped
807 ms*
Commits
Click on a commit to change the comparison rangeBase
master
f8d5a50
-0.46%
test(core): add tests for approximate token counting with multimodal messages
be5736d
2 days ago
by lewisjwhitehill