Commit @91a19d13ccc455dd0afb4215f6ffb755f02de8dc - yjyoon/whisper_server

Y
List All
Feedback
- This Project
- All Projects

thiswillbeyourgithub 2024-09-15

docs: mention quantization example for env variable

@91a19d13ccc455dd0afb4215f6ffb755f02de8dc

5862514

91a19d1

src/faster_whisper_server/config.py

--- src/faster_whisper_server/config.py

+++ src/faster_whisper_server/config.py


 
     Pydantic will automatically handle mapping uppercased environment variables to the corresponding fields.
     To populate nested, the environment should be prefixed with the nested field name and an underscore. For example,
-    the environment variable `LOG_LEVEL` will be mapped to `log_level`, `WHISPER__MODEL`(note the double underscore) to `whisper.model`, etc.
+    the environment variable `LOG_LEVEL` will be mapped to `log_level`, `WHISPER__MODEL`(note the double underscore) to `whisper.model`, to set quantization to int8, use `WHISPER__COMPUTE_TYPE=int8`, etc.
     """  # noqa: E501
 
     model_config = SettingsConfigDict(env_nested_delimiter="__")

Add a comment

Open 0
Closed 0

List

...	...	@@ -170,7 +170,7 @@
170	170
171	171	Pydantic will automatically handle mapping uppercased environment variables to the corresponding fields.
172	172	To populate nested, the environment should be prefixed with the nested field name and an underscore. For example,
173		- the environment variable `LOG_LEVEL` will be mapped to `log_level`, `WHISPER__MODEL`(note the double underscore) to `whisper.model`, etc.
	173	+ the environment variable `LOG_LEVEL` will be mapped to `log_level`, `WHISPER__MODEL`(note the double underscore) to `whisper.model`, to set quantization to int8, use `WHISPER__COMPUTE_TYPE=int8`, etc.
174	174	""" # noqa: E501
175	175
176	176	model_config = SettingsConfigDict(env_nested_delimiter="__")

Delete comment