hossein95 byangderek commited on
Commit
75d7606
·
0 Parent(s):

Duplicate from BreezeBlue/Breeze-TTS-2

Browse files

Co-authored-by: Derek <byangderek@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,424 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ BREEZEBLUE RESEARCH AND NON-COMMERCIAL LICENSE AGREEMENT
2
+
3
+ Version 1.1
4
+ Last Updated: September 1, 2026
5
+
6
+ This BreezeBlue Research and Non-Commercial License Agreement (the
7
+ "Agreement") is entered into between RESONIA, INC., doing business as
8
+ BreezeBlue ("BreezeBlue," "Licensor," "we," or "us"), and the individual or
9
+ entity accessing, using, modifying, or distributing any Model Materials
10
+ ("You," "Your," or "Licensee").
11
+
12
+ By accessing, downloading, using, modifying, or distributing any portion of
13
+ the Model Materials or a Derivative Model, You acknowledge that You have read,
14
+ understood, and agreed to this Agreement. If You act on behalf of an entity,
15
+ You represent that You have authority to bind that entity, and "You" includes
16
+ both You and that entity.
17
+
18
+ This Agreement permits research and non-commercial use of the Model Materials
19
+ free of charge. It does not grant any commercial rights and is not an open
20
+ source license. Commercial use requires a separate written license from
21
+ BreezeBlue.
22
+
23
+
24
+ 1. DEFINITIONS
25
+
26
+ 1.1 "Model" means the Breeze TTS 2 model.
27
+
28
+ 1.2 "Model Materials" means the Model weights, checkpoints, parameters,
29
+ adapters, model-specific tokenizer or codec weights, embeddings, and other
30
+ machine-learning artifacts that BreezeBlue expressly makes available under
31
+ this Agreement, together with any accompanying documentation expressly
32
+ designated as part of the Model Materials.
33
+
34
+ Model Materials do not include source code expressly licensed under the
35
+ Apache License, Version 2.0, or any third-party component made available under
36
+ its own license.
37
+
38
+ 1.3 "Derivative Model" means any modification, adaptation, fine-tune, LoRA,
39
+ merge, quantization, distillation, or other model that is based on or derived
40
+ from the Model Materials, including a model created using the weights,
41
+ parameters, activations, embeddings, or Outputs of the Model Materials to
42
+ replicate or materially transfer their speech or audio generation
43
+ capabilities. Outputs themselves are not Derivative Models.
44
+
45
+ 1.4 "Output" means audio, speech, text, metadata, or other content generated
46
+ by the Model Materials or a Derivative Model in response to an input.
47
+
48
+ 1.5 "Research Purpose" means academic or scientific research that is not
49
+ primarily intended for commercial advantage or monetary compensation,
50
+ including peer-reviewed research, reproducibility studies, benchmarking,
51
+ evaluation, security testing, and red-teaming.
52
+
53
+ 1.6 "Non-Commercial Purpose" means personal, educational, hobbyist, or other
54
+ use that is not primarily intended for commercial advantage or monetary
55
+ compensation, including limited evaluation and testing.
56
+
57
+ 1.7 "Commercial Purpose" means any use primarily intended for or directed
58
+ toward commercial advantage, business benefit, or monetary compensation,
59
+ whether direct or indirect. Commercial Purpose includes, without limitation:
60
+
61
+ (a) production use or use in a product, service, or business operation;
62
+
63
+ (b) hosting or making the Model Materials, a Derivative Model, or their
64
+ functionality available through an API, SaaS offering, application, plug-in,
65
+ website, or other service;
66
+
67
+ (c) creating or providing content, products, or services for a fee, for a
68
+ client, in connection with advertising, sponsorship, subscription revenue,
69
+ or any other monetized activity;
70
+
71
+ (d) using the Model Materials, a Derivative Model, or Outputs for an
72
+ organization's internal operations beyond limited evaluation; or
73
+
74
+ (e) distributing, licensing, selling, or otherwise commercializing the Model
75
+ Materials or a Derivative Model.
76
+
77
+ The status of a Licensee as a for-profit entity does not, by itself, make
78
+ limited internal research, benchmarking, evaluation, security testing, or
79
+ red-teaming a Commercial Purpose, provided that the use is not deployed in
80
+ production, made available to customers or other external end users, used to
81
+ generate revenue, or used to train or improve a non-BreezeBlue generative
82
+ model.
83
+
84
+ 1.8 "Affiliate" means an entity that directly or indirectly controls, is
85
+ controlled by, or is under common control with a party, where "control" means
86
+ ownership or control of more than fifty percent (50%) of the voting interests
87
+ of that entity.
88
+
89
+
90
+ 2. RESEARCH AND NON-COMMERCIAL LICENSE
91
+
92
+ Subject to Your continued compliance with this Agreement, BreezeBlue grants
93
+ You a limited, non-exclusive, worldwide, non-transferable, non-sublicensable,
94
+ royalty-free license under BreezeBlue's intellectual property rights in the
95
+ Model Materials to:
96
+
97
+ (a) access, use, reproduce, and modify the Model Materials;
98
+
99
+ (b) create Derivative Models; and
100
+
101
+ (c) distribute the Model Materials and Derivative Models as expressly
102
+ permitted by Section 4,
103
+
104
+ in each case solely for a Research Purpose or Non-Commercial Purpose.
105
+
106
+ No rights are granted except as expressly stated in this Agreement.
107
+
108
+
109
+ 3. COMMERCIAL USE
110
+
111
+ No Commercial Purpose is permitted under this Agreement. Any Commercial
112
+ Purpose involving the Model Materials, a Derivative Model, or an Output
113
+ requires a separate written commercial license from BreezeBlue.
114
+
115
+ For clarity, this Agreement does not include a creator, content monetization,
116
+ small-business, revenue-threshold, or other implied commercial-use exception.
117
+
118
+ This Agreement governs only the open-weight Model Materials and their
119
+ self-hosted use. Outputs generated through BreezeBlue's hosted products or
120
+ APIs are governed by the applicable Terms of Service, plan terms, and any
121
+ separate written agreement, rather than this Agreement.
122
+
123
+ For commercial licensing inquiries, contact:
124
+
125
+ Website: https://breezeblue.ai
126
+ Email: contact@breeze.blue
127
+
128
+
129
+ 4. DISTRIBUTION AND ATTRIBUTION
130
+
131
+ You may distribute the Model Materials or a Derivative Model solely for a
132
+ Research Purpose or Non-Commercial Purpose and only if You:
133
+
134
+ (a) provide every recipient with a complete copy of this Agreement and any
135
+ NOTICE file accompanying the Model Materials;
136
+
137
+ (b) retain all copyright, attribution, provenance, and proprietary notices;
138
+
139
+ (c) include the following notice in a NOTICE file distributed with the Model
140
+ Materials or Derivative Model:
141
+
142
+ "Breeze TTS 2 is licensed under the BreezeBlue Research and Non-Commercial
143
+ License Agreement. Copyright (c) 2026 RESONIA, INC. All Rights Reserved.";
144
+
145
+ (d) clearly identify any modifications You made and, for a Derivative Model,
146
+ state prominently in its model card, repository, and documentation:
147
+
148
+ "Derived from Breeze TTS 2 by BreezeBlue and licensed for research and
149
+ non-commercial use only.";
150
+
151
+ (e) license the distributed Model Materials or Derivative Model under this
152
+ Agreement without adding terms that conflict with or reduce the protections
153
+ of this Agreement.
154
+
155
+ You may not use "BreezeBlue," "Breeze TTS 2," or any confusingly similar name
156
+ as the primary name of a Derivative Model, product, or service, or in any way
157
+ that suggests endorsement, affiliation, official status, or successor status.
158
+ Reasonable descriptive attribution required by this Section is permitted.
159
+
160
+ Publication of non-commercial research results, benchmark results, and
161
+ illustrative samples in papers, reports, conference presentations, model
162
+ cards, repositories, or non-monetized demonstrations is permitted, provided
163
+ that You reasonably acknowledge Breeze TTS 2 and comply with this Agreement.
164
+
165
+
166
+ 5. USE RESTRICTIONS
167
+
168
+ You will not, and will not permit any third party to:
169
+
170
+ (a) use the Model Materials, a Derivative Model, or any Output for a
171
+ Commercial Purpose without a separate written commercial license;
172
+
173
+ (b) use the Model Materials, a Derivative Model, or any Output to create,
174
+ train, fine-tune, distill, evaluate for training selection, or otherwise
175
+ improve any non-BreezeBlue foundational or generative speech, audio,
176
+ language, or multimodal model, except for creating a Derivative Model solely
177
+ for a Research Purpose or Non-Commercial Purpose under this Agreement;
178
+
179
+ (c) use the Model Materials, a Derivative Model, or any Output to clone,
180
+ simulate, imitate, or impersonate a real person's voice, identity, likeness,
181
+ or persona without that person's explicit and legally sufficient consent;
182
+
183
+ (d) submit or use reference audio, speaker embeddings, voice prompts,
184
+ recordings, performances, or other materials unless You have all rights,
185
+ licenses, permissions, and consents necessary for that use;
186
+
187
+ (e) use the Model Materials, a Derivative Model, or any Output to defraud,
188
+ deceive, harass, stalk, threaten, defame, exploit, or cause harm to any person;
189
+
190
+ (f) generate or distribute sexual, exploitative, or otherwise harmful content
191
+ involving a minor;
192
+
193
+ (g) engage in deceptive political persuasion, election interference, voter
194
+ suppression, synthetic robocalls, or false impersonation of a candidate,
195
+ public official, or other person in a political context;
196
+
197
+ (h) identify, authenticate, track, surveil, or profile a person using voice or
198
+ other biometric characteristics without a lawful basis and all consent
199
+ required by applicable law;
200
+
201
+ (i) distribute synthetic audio in circumstances where a reasonable person
202
+ would be materially misled about its origin or authenticity, or fail to make
203
+ any disclosure required by applicable law;
204
+
205
+ (j) remove, obscure, alter, or circumvent any copyright notice, attribution,
206
+ watermark, provenance signal, safety mechanism, or other proprietary notice
207
+ included in the Model Materials or Outputs;
208
+
209
+ (k) attempt to extract or reconstruct non-public training data, source data,
210
+ trade secrets, or proprietary components from the Model Materials, except to
211
+ the extent such a restriction is prohibited by applicable law; or
212
+
213
+ (l) use, export, re-export, transfer, or make available the Model Materials or
214
+ a Derivative Model in violation of any applicable law, regulation, export
215
+ control, or trade sanction.
216
+
217
+ Nothing in Section 5(k) prohibits ordinary inspection, loading, conversion,
218
+ quantization, modification, or fine-tuning of the released Model Materials as
219
+ expressly permitted by this Agreement.
220
+
221
+
222
+ 6. LEGAL COMPLIANCE AND THIRD-PARTY RIGHTS
223
+
224
+ You are solely responsible for ensuring that Your use of the Model Materials,
225
+ Derivative Models, inputs, and Outputs complies with all applicable laws and
226
+ regulations and does not infringe or violate any third-party right, including
227
+ intellectual property, privacy, publicity, biometric privacy,
228
+ recording-consent, consumer-protection, election, and other applicable rights.
229
+
230
+ This Agreement grants no right to use, reproduce, clone, simulate, imitate,
231
+ or otherwise exploit any third-party voice, identity, likeness, persona,
232
+ performance, recording, copyrighted work, trademark, or other protected
233
+ material. You are solely responsible for obtaining all necessary rights,
234
+ licenses, permissions, notices, and consents.
235
+
236
+ BreezeBlue does not represent or warrant that any Model Material or Output is
237
+ cleared for Your intended use, unique, accurate, non-infringing, or suitable
238
+ for any particular purpose.
239
+
240
+
241
+ 7. INTELLECTUAL PROPERTY
242
+
243
+ 7.1 Model Materials. BreezeBlue and its licensors retain all right, title, and
244
+ interest in and to the Model Materials. Except for the limited license granted
245
+ in Section 2, no right or interest in the Model Materials is transferred to
246
+ You.
247
+
248
+ 7.2 Derivative Models. As between You and BreezeBlue, You own the original
249
+ modifications You contribute to a Derivative Model, to the extent permitted by
250
+ applicable law. That ownership is subject to BreezeBlue's ownership of the
251
+ underlying Model Materials and to every restriction in this Agreement. A
252
+ Derivative Model remains governed by this Agreement.
253
+
254
+ 7.3 Outputs. As between You and BreezeBlue, and to the extent permitted by
255
+ applicable law, You own Outputs You lawfully generate. Output ownership does
256
+ not remove or limit the non-commercial restrictions in this Agreement, grant
257
+ rights in third-party material, or authorize any use prohibited by this
258
+ Agreement.
259
+
260
+ 7.4 Trademarks. No trademark license is granted except the limited right to
261
+ make accurate descriptive references required for attribution under Section
262
+ 4. All goodwill arising from permitted use of BreezeBlue's marks belongs to
263
+ BreezeBlue.
264
+
265
+ 7.5 Feedback. If You voluntarily provide suggestions, comments, or other
266
+ feedback about the Model Materials, You grant BreezeBlue a perpetual,
267
+ irrevocable, worldwide, royalty-free, fully paid, transferable, sublicensable,
268
+ non-exclusive license to use and exploit that feedback without restriction or
269
+ compensation.
270
+
271
+ 7.6 Intellectual Property Claims. If You or Your Affiliate brings a claim or
272
+ legal proceeding alleging that the Model Materials, a Derivative Model, or an
273
+ Output infringes intellectual property rights owned or licensable by You or
274
+ Your Affiliate, the licenses granted to You under this Agreement terminate
275
+ automatically when the claim or proceeding is filed.
276
+
277
+
278
+ 8. REPRESENTATIONS
279
+
280
+ You represent and warrant that:
281
+
282
+ (a) You have legal capacity and authority to enter into this Agreement;
283
+
284
+ (b) You will use and distribute the Model Materials, Derivative Models, and
285
+ Outputs only as permitted by this Agreement;
286
+
287
+ (c) You have all necessary rights and consents for Your inputs and intended
288
+ uses; and
289
+
290
+ (d) You are not prohibited from receiving or using the Model Materials under
291
+ applicable export-control, sanctions, or other laws.
292
+
293
+
294
+ 9. DISCLAIMER OF WARRANTIES
295
+
296
+ TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, THE MODEL MATERIALS,
297
+ DERIVATIVE MODELS, OUTPUTS, AND ALL RELATED MATERIALS ARE PROVIDED "AS IS" AND
298
+ "AS AVAILABLE," WITH ALL FAULTS AND WITHOUT WARRANTIES OF ANY KIND, WHETHER
299
+ EXPRESS, IMPLIED, STATUTORY, OR OTHERWISE.
300
+
301
+ BREEZEBLUE DISCLAIMS ALL WARRANTIES, INCLUDING WARRANTIES OF TITLE,
302
+ NON-INFRINGEMENT, MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE,
303
+ ACCURACY, RELIABILITY, SECURITY, AND ANY WARRANTY THAT THE MODEL MATERIALS OR
304
+ OUTPUTS WILL BE ERROR-FREE, UNINTERRUPTED, UNIQUE, OR SUITABLE FOR YOUR USE.
305
+
306
+ YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS AND LAWFULNESS
307
+ OF YOUR USE AND ASSUME ALL RISKS ARISING FROM THAT USE.
308
+
309
+
310
+ 10. LIMITATION OF LIABILITY
311
+
312
+ TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, BREEZEBLUE AND ITS
313
+ AFFILIATES, LICENSORS, OFFICERS, DIRECTORS, EMPLOYEES, CONTRACTORS, AND AGENTS
314
+ WILL NOT BE LIABLE UNDER ANY THEORY OF LIABILITY FOR ANY INDIRECT, INCIDENTAL,
315
+ SPECIAL, CONSEQUENTIAL, EXEMPLARY, OR PUNITIVE DAMAGES, OR FOR ANY LOSS OF
316
+ PROFITS, REVENUE, BUSINESS, GOODWILL, DATA, OR USE, ARISING OUT OF OR RELATING
317
+ TO THIS AGREEMENT, THE MODEL MATERIALS, ANY DERIVATIVE MODEL, OR ANY OUTPUT,
318
+ EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
319
+
320
+ TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, BREEZEBLUE'S TOTAL
321
+ AGGREGATE LIABILITY ARISING OUT OF OR RELATING TO THIS AGREEMENT WILL NOT
322
+ EXCEED ONE HUNDRED U.S. DOLLARS (US$100).
323
+
324
+
325
+ 11. INDEMNIFICATION
326
+
327
+ You agree to defend, indemnify, and hold harmless BreezeBlue and its
328
+ Affiliates, licensors, officers, directors, employees, contractors, and agents
329
+ from and against any third-party claim, demand, action, proceeding, damage,
330
+ loss, liability, judgment, settlement, cost, or expense, including reasonable
331
+ attorneys' fees, arising out of or relating to:
332
+
333
+ (a) Your access to, use, modification, or distribution of the Model Materials
334
+ or a Derivative Model;
335
+
336
+ (b) Your inputs or Outputs;
337
+
338
+ (c) Your violation of this Agreement or applicable law; or
339
+
340
+ (d) Your infringement, misappropriation, or violation of any third-party
341
+ right.
342
+
343
+
344
+ 12. TERM AND TERMINATION
345
+
346
+ This Agreement begins when You first access or use the Model Materials and
347
+ continues until terminated.
348
+
349
+ BreezeBlue may terminate this Agreement if You materially breach it. For a
350
+ material breach that is reasonably capable of cure, BreezeBlue will provide
351
+ written notice and at least thirty (30) days to cure before termination.
352
+ BreezeBlue may terminate immediately for a breach of Section 3, Section 5, or
353
+ applicable law, or where delay would reasonably create legal, security, fraud,
354
+ or safety risk.
355
+
356
+ Upon termination, You must immediately cease using and distributing the Model
357
+ Materials and Derivative Models, delete all copies under Your control, and,
358
+ upon reasonable request, confirm deletion in writing. Termination does not
359
+ require deletion of an Output lawfully created before termination, but no
360
+ Output may be used in violation of this Agreement or applicable law.
361
+
362
+ BreezeBlue may stop distributing the Model Materials prospectively. Such
363
+ discontinuation alone does not terminate rights already granted to a Licensee
364
+ that remains in compliance with this Agreement.
365
+
366
+ Sections 3, 5, 6, 7, 9, 10, 11, 12, and 13 survive termination to the extent
367
+ necessary to give them effect.
368
+
369
+
370
+ 13. GOVERNING LAW AND JURISDICTION
371
+
372
+ This Agreement is governed by and construed in accordance with the laws of the
373
+ State of Delaware, without regard to its conflict-of-laws principles. The
374
+ United Nations Convention on Contracts for the International Sale of Goods
375
+ does not apply.
376
+
377
+ To the extent permitted by applicable law, any dispute arising out of or
378
+ relating to this Agreement shall be brought exclusively in the state or
379
+ federal courts located in the State of Delaware, and each party consents to
380
+ the personal jurisdiction and venue of those courts.
381
+
382
+
383
+ 14. MISCELLANEOUS
384
+
385
+ 14.1 Entire Agreement. This Agreement and any NOTICE file accompanying the
386
+ Model Materials constitute the entire agreement concerning the Model
387
+ Materials and supersede prior or contemporaneous understandings concerning
388
+ the same subject matter.
389
+
390
+ 14.2 Separate Software Licenses. Source code and third-party components may be
391
+ made available under separate licenses. Those separate licenses govern only
392
+ the materials expressly identified as subject to them and do not grant any
393
+ right to use the Model Materials.
394
+
395
+ 14.3 Assignment. You may not assign or transfer this Agreement or any right
396
+ under it without BreezeBlue's prior written consent. BreezeBlue may assign
397
+ this Agreement in connection with a merger, acquisition, reorganization, sale
398
+ of assets, or operation of law.
399
+
400
+ 14.4 Severability. If any provision is held invalid or unenforceable, it will
401
+ be enforced to the maximum extent permitted, and the remaining provisions
402
+ will remain in effect.
403
+
404
+ 14.5 No Waiver. Failure to enforce a provision is not a waiver of the right to
405
+ enforce it later.
406
+
407
+ 14.6 No Endorsement. Nothing in this Agreement creates an agency,
408
+ partnership, joint venture, employment, fiduciary, sponsorship, or endorsement
409
+ relationship between the parties.
410
+
411
+ 14.7 Updates. BreezeBlue may publish new versions of this Agreement. A new
412
+ version applies only if You expressly accept it or access Model Materials
413
+ released under that new version. Your continued use of a previously obtained
414
+ version of the Model Materials remains governed by the version You accepted,
415
+ unless applicable law requires otherwise.
416
+
417
+
418
+ 15. CONTACT
419
+
420
+ Questions and commercial licensing requests may be sent to:
421
+
422
+ RESONIA, INC., doing business as BreezeBlue
423
+ Website: https://breezeblue.ai
424
+ Email: contact@breeze.blue
README.md ADDED
@@ -0,0 +1,204 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - zh
5
+ library_name: transformers
6
+ pipeline_tag: text-to-speech
7
+ license: other
8
+ license_name: breezeblue-research-and-non-commercial-license
9
+ license_link: LICENSE
10
+ tags:
11
+ - text-to-speech
12
+ - speech-generation
13
+ - voice-clone
14
+ - voice-design
15
+ - voice-direction
16
+ - pytorch
17
+ - cuda
18
+ ---
19
+ <div align="center">
20
+ <a href="https://breezeblue.ai/"><img src="assets/breezeblue-logo.png" alt="BreezeBlue" width="35%"></a>
21
+ <br>
22
+ <a href="https://github.com/breezeblue-ai/breeze-tts"><img src="https://img.shields.io/badge/GitHub-breeze--tts-181717?logo=github&logoColor=white" alt="GitHub"></a>
23
+ <a href="https://breezeblue.ai/breeze-tts-2"><img src="https://img.shields.io/badge/Blog-Breeze%20TTS%202-2563EB" alt="Blog"></a>
24
+ <a href="https://breezeblue.ai/"><img src="https://img.shields.io/badge/Website-BreezeBlue-0EA5E9" alt="Website"></a>
25
+ <a href="https://discord.com/invite/6H7AgPe9pA"><img src="https://img.shields.io/badge/Discord-Join%20us-5865F2?logo=discord&logoColor=white" alt="Discord"></a>
26
+ <a href="https://x.com/BreezeBlueX"><img src="https://img.shields.io/badge/X-Follow%20BreezeBlue-000000?logo=x&logoColor=white" alt="X"></a>
27
+ </div>
28
+
29
+ > [!IMPORTANT]
30
+ > Source code is licensed under Apache 2.0. Breeze TTS 2 model weights, derivative models, and self-hosted outputs are for research and non-commercial use only. See [License](#license-and-responsible-use).
31
+
32
+ ## 📰 News
33
+
34
+ - **[2026.08.25]** 🎉 We release [Breeze TTS 2](https://huggingface.co/BreezeBlue/breeze-tts-2) model weights and the [PyTorch inference code](https://github.com/breezeblue-ai/breeze-tts).
35
+ - **[2026.08.07]** 🔥 We release the TTS benchmark suite for [voice design](https://github.com/breezeblue-ai/tts-voice-design-benchmark), [voice direction](https://github.com/breezeblue-ai/TTS-Voice-Direction-Benchmark), and [latency evaluation](https://github.com/breezeblue-ai/TTS-Latency-Benchmark).
36
+
37
+ ## 📖 Introduction
38
+
39
+ Breeze TTS 2 is an open-weight text-to-speech model built for real-time interaction. It ranks #1 among open-weight models on the Artificial Analysis TTS leaderboard, while outperforming frontier proprietary systems. Its open-ended natural-language instruction-following capability supports reference-free voice design and reference-guided voice direction, while ultra-low-latency streaming enables responsive, expressive interaction.
40
+
41
+ <div align="center">
42
+ <img src="assets/tts-elo-leaderboard.svg" alt="Text-to-speech models ranked by Artificial Analysis Elo score" width="100%">
43
+ </div>
44
+
45
+ ## ✨ Highlights
46
+
47
+ - 🎙️ **Voice Clone** — Uses reference audio with its exact transcript to preserve timbre, rhythm, emotion, and style.
48
+ - 🎨 **Voice Design** — Creates a distinctive voice from a natural-language description, without reference audio.
49
+ - 🎛️ **Voice Direction** — Clones a voice from reference audio while steering tone, emotion, pace, and delivery.
50
+ - 🎭 **Vocal Events** — Adds expressive inline events directly in the text: use parentheses in English, such as `(laugh)`, `(cough)`, `(clears throat)`, and `(sigh)`; use square brackets in Chinese, such as `[笑]`, `[咳嗽]`, `[清嗓子]`, and `[叹气]`.
51
+ - ⚡ **Ultra-Low Latency** — Achieves under 40 ms time to first audio (TTFA) with the warmed-up fast path on an NVIDIA H100.
52
+ - 🌊 **Real-Time Streaming** — Reaches a 0.32 real-time factor (RTF), generating audio at approximately 3.1× real time with the warmed-up fast path on an NVIDIA H100.
53
+ - 💾 **GPU-Efficient** — Eager inference uses approximately 7.7 GiB of GPU memory; a 12 GB GPU is the minimum recommended configuration.
54
+ - 🌏 **Bilingual Support** — Generates natural English and Chinese speech with a single model.
55
+
56
+ ## 🚀 Quick Start
57
+
58
+ ### Requirements
59
+
60
+ - Linux and Python 3.10 or newer
61
+ - A CUDA-capable NVIDIA GPU
62
+ - GPU memory: approximately 7.7 GiB for eager inference or 14.4 GiB with `--fast-all`; use a 12 GB GPU for eager or a 24 GB GPU for the fast path
63
+ - The Breeze TTS 2 checkpoint
64
+
65
+ ### Installation
66
+
67
+ Download the inference code:
68
+
69
+ ```bash
70
+ git clone https://github.com/breezeblue-ai/breeze-tts.git
71
+ cd breeze-tts
72
+ ```
73
+
74
+ Install the dependencies:
75
+
76
+ ```bash
77
+ python -m pip install -r requirements.txt
78
+ ```
79
+
80
+ All required model components are included in the Breeze TTS 2 checkpoint.
81
+
82
+ For the tested CUDA environment, build the included Docker image:
83
+
84
+ ```bash
85
+ bash docker/build.sh
86
+ ```
87
+
88
+ The default image targets H100/Hopper (sm90). For A100:
89
+
90
+ ```bash
91
+ FLASH_ATTN_CUDA_ARCHS=80 bash docker/build.sh
92
+ ```
93
+
94
+ ### 🎙️ Voice Clone
95
+
96
+ Clone a speaker from clean reference audio and its exact transcript.
97
+
98
+ #### English
99
+
100
+ ```bash
101
+ python infer.py ../breeze-tts-2 \
102
+ --ref-audio reference_en.wav \
103
+ --ref-text "This is the exact transcript of the English reference audio." \
104
+ --text "(sigh) It is good to hear your voice again after all this time." \
105
+ --output outputs/voice_clone_en.wav
106
+ ```
107
+
108
+ #### Chinese
109
+
110
+ ```bash
111
+ python infer.py ../breeze-tts-2 \
112
+ --ref-audio reference_zh.wav \
113
+ --ref-text "这是中文参考音频的准确文字稿。" \
114
+ --text "[叹气] 没想到过了这么久,你还记得我的声音。" \
115
+ --output outputs/voice_clone_zh.wav
116
+ ```
117
+
118
+ Reference audio should contain clean speech with minimal background noise.
119
+
120
+ ### 🎨 Voice Design
121
+
122
+ Create a voice from a natural-language description without reference audio. Match the instruction language to the target text. Use `--cfg-scale 4` to strengthen instruction-following.
123
+
124
+ #### English
125
+
126
+ ```bash
127
+ python infer.py ../breeze-tts-2 \
128
+ --text "(sigh) Welcome aboard. Your journey begins now." \
129
+ --instruction "A warm, thoughtful young woman with a clear voice and a calm, reflective delivery." \
130
+ --cfg-scale 4 \
131
+ --output outputs/voice_design_en.wav
132
+ ```
133
+
134
+ #### Chinese
135
+
136
+ ```bash
137
+ python infer.py ../breeze-tts-2 \
138
+ --text "[笑] 欢迎来到今晚的故事时间,让我们一起开始吧。" \
139
+ --instruction "一位温柔自信的年轻女性,声音清晰,语气亲切,表达轻快而富有感染力。" \
140
+ --cfg-scale 4 \
141
+ --output outputs/voice_design_zh.wav
142
+ ```
143
+
144
+ ### 🎛️ Voice Direction
145
+
146
+ Keep the identity of a reference speaker while directing tone, emotion, pace, and delivery. Use `--cfg-scale 4` to strengthen instruction-following.
147
+
148
+ ```bash
149
+ python infer.py ../breeze-tts-2 \
150
+ --ref-audio reference.wav \
151
+ --ref-text "This is the exact transcript of the reference audio." \
152
+ --text "(clears throat) We need to discuss what happened last night." \
153
+ --instruction "Speak slowly with a restrained, serious tone." \
154
+ --cfg-scale 4 \
155
+ --output outputs/voice_direction.wav
156
+ ```
157
+
158
+ ### 🌐 Streaming API
159
+
160
+ Start the single-concurrency streaming API. It uses the same PyTorch runtime and eager execution by default:
161
+
162
+ ```bash
163
+ python -m breeze_infer.api ../breeze-tts-2 --host 0.0.0.0 --port 7860
164
+ ```
165
+
166
+ Send a Voice Direction request with reference audio and CFG 4:
167
+
168
+ ```bash
169
+ curl -X POST http://127.0.0.1:7860/v1/audio/speech \
170
+ -F "cfg_scale=4" \
171
+ -F "ref_audio=@reference.wav" \
172
+ -F "ref_text=This is the exact transcript of the reference audio." \
173
+ -F "text=(clears throat) We need to discuss what happened last night." \
174
+ -F "instruction=Speak slowly with a restrained, serious tone." \
175
+ -F "seed=42" \
176
+ --output voice_direction.pcm
177
+ ```
178
+
179
+ The response is streaming mono 24 kHz signed 16-bit little-endian PCM. Start the API with `--fast-all` to enable the fast path.
180
+
181
+ ### ⚡ Fast Inference Options
182
+
183
+ Both the CLI and API use eager streaming by default and skip graph warmup. Pass `--fast-all` to enable the best configuration for every inference stage when the additional cold-start time is acceptable. Each stage can also be controlled independently:
184
+
185
+ | Stage | Fast parameter | Disabled | Enabled |
186
+ | --- | --- | --- | --- |
187
+ | Text encoder | `--[no-]fast-text-encoder` | Native eager forward | Static CUDA Graph selected by CFG shape and text-length bucket |
188
+ | Backbone prefill | `--[no-]fast-backbone-prefill` | Native eager prefill | CUDA Graph selected by CFG shape and prompt-length bucket |
189
+ | Backbone decode | `--[no-]fast-backbone-decode` | Native eager token step | StaticCache-backed graph selected by CFG shape |
190
+ | Depth decoder | `--[no-]fast-depth-decoder` | Native eager depth loop | Full-graph compilation with CFG-shape CUDA Graphs |
191
+ | Codec | `--[no-]fast-codec` | Eager streaming decode | Single-request streaming CUDA Graph with one-frame chunks |
192
+
193
+ Individual stage flags are intended for profiling and debugging.
194
+
195
+
196
+ ## License and Responsible Use
197
+
198
+ The source code is licensed under the [Apache License, Version 2.0](https://github.com/breezeblue-ai/breeze-tts/blob/main/LICENSE). The audio tokenizer is based on [Qwen3-TTS](https://github.com/QwenLM/Qwen3-TTS) by the Alibaba Qwen Team and is licensed under the Apache License, Version 2.0. Model weights, checkpoints, adapters, derivative models, and self-hosted outputs are governed separately by the [BreezeBlue Research and Non-Commercial License](https://huggingface.co/BreezeBlue/Breeze-TTS-2/blob/main/LICENSE). The Apache License does not grant rights to use the model commercially.
199
+
200
+ If you have an active paid subscription, outputs you generate through BreezeBlue's hosted platform or API at [breezeblue.ai](https://breezeblue.ai/) can be used commercially, subject to our [Terms of Service](https://breezeblue.ai/legal/terms). A paid subscription does not grant commercial rights to the open-weight model or self-hosted outputs.
201
+
202
+ You are responsible for complying with applicable laws and obtaining all necessary rights and consents for inputs, reference audio, voices, and outputs. Unauthorized voice cloning, impersonation, fraud, and other unlawful or harmful uses are prohibited.
203
+
204
+ The code and Model Materials are provided "AS IS," without warranties or liability to the maximum extent permitted by law. Third-party components remain subject to their respective licenses.
assets/breezeblue-logo.png ADDED
assets/tts-elo-leaderboard.svg ADDED
audio_tokenizer/config.json ADDED
@@ -0,0 +1,94 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3TTSTokenizerV2Model"
4
+ ],
5
+ "model_type": "qwen3_tts_tokenizer_12hz",
6
+ "encoder_valid_num_quantizers": 16,
7
+ "input_sample_rate": 24000,
8
+ "output_sample_rate": 24000,
9
+ "decode_upsample_rate": 1920,
10
+ "encode_downsample_rate": 1920,
11
+ "decoder_config": {
12
+ "attention_bias": false,
13
+ "attention_dropout": 0.0,
14
+ "latent_dim": 1024,
15
+ "codebook_dim": 512,
16
+ "codebook_size": 2048,
17
+ "decoder_dim": 1536,
18
+ "hidden_act": "silu",
19
+ "hidden_size": 512,
20
+ "intermediate_size": 1024,
21
+ "layer_scale_initial_scale": 0.01,
22
+ "max_position_embeddings": 8000,
23
+ "head_dim": 64,
24
+ "num_attention_heads": 16,
25
+ "num_hidden_layers": 8,
26
+ "num_key_value_heads": 16,
27
+ "num_quantizers": 16,
28
+ "num_semantic_quantizers": 1,
29
+ "rms_norm_eps": 1e-05,
30
+ "rope_theta": 10000,
31
+ "semantic_codebook_size": 4096,
32
+ "sliding_window": 72,
33
+ "upsample_rates": [
34
+ 8,
35
+ 5,
36
+ 4,
37
+ 3
38
+ ],
39
+ "upsampling_ratios": [
40
+ 2,
41
+ 2
42
+ ],
43
+ "vector_quantization_hidden_dimension": 512
44
+ },
45
+ "encoder_config": {
46
+ "_frame_rate": 12.5,
47
+ "attention_bias": false,
48
+ "attention_dropout": 0.0,
49
+ "audio_channels": 1,
50
+ "codebook_dim": 256,
51
+ "codebook_size": 2048,
52
+ "compress": 2,
53
+ "dilation_growth_rate": 2,
54
+ "dtype": "float32",
55
+ "head_dim": 64,
56
+ "hidden_act": "gelu",
57
+ "hidden_size": 512,
58
+ "initializer_range": 0.02,
59
+ "intermediate_size": 2048,
60
+ "kernel_size": 7,
61
+ "last_kernel_size": 3,
62
+ "layer_scale_initial_scale": 0.01,
63
+ "max_position_embeddings": 8000,
64
+ "norm_eps": 1e-05,
65
+ "normalize": false,
66
+ "num_attention_heads": 8,
67
+ "num_filters": 64,
68
+ "num_hidden_layers": 8,
69
+ "num_key_value_heads": 8,
70
+ "num_quantizers": 32,
71
+ "num_residual_layers": 1,
72
+ "num_semantic_quantizers": 1,
73
+ "pad_mode": "constant",
74
+ "residual_kernel_size": 3,
75
+ "rope_theta": 10000.0,
76
+ "sampling_rate": 24000,
77
+ "sliding_window": 250,
78
+ "transformers_version": "4.57.0.dev0",
79
+ "trim_right_ratio": 1.0,
80
+ "upsample_groups": 512,
81
+ "upsampling_ratios": [
82
+ 8,
83
+ 6,
84
+ 5,
85
+ 4
86
+ ],
87
+ "use_cache": false,
88
+ "use_causal_conv": true,
89
+ "use_conv_shortcut": false,
90
+ "use_streaming": false,
91
+ "vector_quantization_hidden_dimension": 256
92
+ },
93
+ "transformers_version": "4.57.3"
94
+ }
audio_tokenizer/configuration.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"framework": "pytorch", "task": "feature-extraction", "allow_remote": true}
audio_tokenizer/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:836b7b357f5ea43e889936a3709af68dfe3751881acefe4ecf0dbd30ba571258
3
+ size 682293092
audio_tokenizer/preprocessor_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "chunk_length_s": null,
3
+ "feature_extractor_type": "EncodecFeatureExtractor",
4
+ "feature_size": 1,
5
+ "overlap": null,
6
+ "padding_side": "right",
7
+ "padding_value": 0.0,
8
+ "return_attention_mask": true,
9
+ "sampling_rate": 24000
10
+ }
config.json ADDED
@@ -0,0 +1,441 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BreezeForConditionalGeneration"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "audio_embed_size": 2048,
8
+ "audio_eos_token_id": 262145,
9
+ "audio_num_codebooks": 16,
10
+ "audio_token_id": 262144,
11
+ "audio_vocab_size": 2051,
12
+ "backbone_flavor": "llama-1B",
13
+ "backbone_model_name_or_path": null,
14
+ "backbone_model_type": "qwen3",
15
+ "bos_token_id": 2,
16
+ "codebook_eos_token_id": 0,
17
+ "codebook_pad_token_id": 2050,
18
+ "codec_config": {
19
+ "_frame_rate": 12.5,
20
+ "_name_or_path": "kyutai/mimi",
21
+ "architectures": [
22
+ "MimiModel"
23
+ ],
24
+ "attention_bias": false,
25
+ "attention_dropout": 0.0,
26
+ "audio_channels": 1,
27
+ "codebook_dim": 256,
28
+ "codebook_size": 2048,
29
+ "compress": 2,
30
+ "dilation_growth_rate": 2,
31
+ "dtype": "bfloat16",
32
+ "head_dim": 64,
33
+ "hidden_act": "gelu",
34
+ "hidden_size": 512,
35
+ "initializer_range": 0.02,
36
+ "intermediate_size": 2048,
37
+ "kernel_size": 7,
38
+ "last_kernel_size": 3,
39
+ "layer_scale_initial_scale": 0.01,
40
+ "max_position_embeddings": 8000,
41
+ "model_type": "mimi",
42
+ "norm_eps": 0.00001,
43
+ "normalize": false,
44
+ "num_attention_heads": 8,
45
+ "num_filters": 64,
46
+ "num_hidden_layers": 8,
47
+ "num_key_value_heads": 8,
48
+ "num_quantizers": 32,
49
+ "num_residual_layers": 1,
50
+ "num_semantic_quantizers": 1,
51
+ "pad_mode": "constant",
52
+ "residual_kernel_size": 3,
53
+ "rope_theta": 10000.0,
54
+ "sampling_rate": 24000,
55
+ "sliding_window": 250,
56
+ "trim_right_ratio": 1.0,
57
+ "upsample_groups": 512,
58
+ "upsampling_ratios": [
59
+ 8,
60
+ 6,
61
+ 5,
62
+ 4
63
+ ],
64
+ "use_cache": false,
65
+ "use_causal_conv": true,
66
+ "use_conv_shortcut": false,
67
+ "use_streaming": false,
68
+ "vector_quantization_hidden_dimension": 256
69
+ },
70
+ "decoder_flavor": "llama-100M",
71
+ "depth_decoder_config": {
72
+ "attention_bias": false,
73
+ "attention_dropout": 0.0,
74
+ "audio_embed_size": 2048,
75
+ "backbone_hidden_size": 2048,
76
+ "codebook_loss_weights": [
77
+ 3
78
+ ],
79
+ "dtype": "bfloat16",
80
+ "head_dim": 128,
81
+ "hidden_act": "silu",
82
+ "hidden_size": 1024,
83
+ "initializer_range": 0.02,
84
+ "intermediate_size": 8192,
85
+ "max_position_embeddings": 33,
86
+ "mlp_bias": false,
87
+ "model_type": "breeze_depth_decoder_model",
88
+ "num_attention_heads": 8,
89
+ "num_codebooks": 16,
90
+ "num_hidden_layers": 12,
91
+ "num_key_value_heads": 2,
92
+ "rms_norm_eps": 0.00001,
93
+ "rope_scaling": {
94
+ "factor": 32.0,
95
+ "high_freq_factor": 0.0078125,
96
+ "low_freq_factor": 0.001953125,
97
+ "original_max_position_embeddings": 16,
98
+ "rope_type": "llama3"
99
+ },
100
+ "rope_theta": 500000,
101
+ "use_cache": true,
102
+ "vocab_size": 2051
103
+ },
104
+ "depth_header_loss_weight": 1.0,
105
+ "dtype": "bfloat16",
106
+ "eos_token_id": 1,
107
+ "head_dim": 128,
108
+ "hidden_act": "silu",
109
+ "hidden_size": 2048,
110
+ "initializer_range": 0.02,
111
+ "intermediate_size": 6144,
112
+ "max_position_embeddings": 2048,
113
+ "mlp_bias": false,
114
+ "model_type": "breeze",
115
+ "num_attention_heads": 16,
116
+ "num_codebooks": 16,
117
+ "num_hidden_layers": 28,
118
+ "num_key_value_heads": 8,
119
+ "pad_token_id": 0,
120
+ "rms_norm_eps": 0.00001,
121
+ "rope_scaling": {
122
+ "factor": 32.0,
123
+ "high_freq_factor": 0.5,
124
+ "low_freq_factor": 0.125,
125
+ "original_max_position_embeddings": 1024,
126
+ "rope_type": "llama3"
127
+ },
128
+ "rope_theta": 500000,
129
+ "text_encoder_bucket_max_length_ratio": 4.0,
130
+ "text_encoder_config": {
131
+ "add_cross_attention": false,
132
+ "architectures": [
133
+ "T5Gemma2TextEncoder"
134
+ ],
135
+ "attention_bias": false,
136
+ "attention_dropout": 0.0,
137
+ "attn_logit_softcapping": null,
138
+ "bad_words_ids": null,
139
+ "begin_suppress_tokens": null,
140
+ "bos_token_id": 2,
141
+ "chunk_size_feed_forward": 0,
142
+ "cross_attention_hidden_size": null,
143
+ "decoder_start_token_id": null,
144
+ "diversity_penalty": 0.0,
145
+ "do_sample": false,
146
+ "dropout_rate": 0.0,
147
+ "dtype": "bfloat16",
148
+ "early_stopping": false,
149
+ "encoder_no_repeat_ngram_size": 0,
150
+ "eoi_token_index": 256000,
151
+ "eos_token_id": 1,
152
+ "exponential_decay_length_penalty": null,
153
+ "final_logit_softcapping": null,
154
+ "finetuning_task": null,
155
+ "forced_bos_token_id": null,
156
+ "forced_eos_token_id": null,
157
+ "head_dim": 256,
158
+ "hidden_activation": "gelu_pytorch_tanh",
159
+ "hidden_size": 1152,
160
+ "id2label": {
161
+ "0": "LABEL_0",
162
+ "1": "LABEL_1"
163
+ },
164
+ "initializer_range": 0.02,
165
+ "intermediate_size": 6912,
166
+ "is_decoder": false,
167
+ "is_encoder_decoder": false,
168
+ "label2id": {
169
+ "LABEL_0": 0,
170
+ "LABEL_1": 1
171
+ },
172
+ "layer_types": [
173
+ "sliding_attention",
174
+ "sliding_attention",
175
+ "sliding_attention",
176
+ "sliding_attention",
177
+ "sliding_attention",
178
+ "full_attention",
179
+ "sliding_attention",
180
+ "sliding_attention",
181
+ "sliding_attention",
182
+ "sliding_attention",
183
+ "sliding_attention",
184
+ "full_attention",
185
+ "sliding_attention",
186
+ "sliding_attention",
187
+ "sliding_attention",
188
+ "sliding_attention",
189
+ "sliding_attention",
190
+ "full_attention",
191
+ "sliding_attention",
192
+ "sliding_attention",
193
+ "sliding_attention",
194
+ "sliding_attention",
195
+ "sliding_attention",
196
+ "full_attention",
197
+ "sliding_attention",
198
+ "sliding_attention"
199
+ ],
200
+ "length_penalty": 1.0,
201
+ "max_length": 20,
202
+ "max_position_embeddings": 32768,
203
+ "min_length": 0,
204
+ "model_type": "t5gemma2_text",
205
+ "no_repeat_ngram_size": 0,
206
+ "num_attention_heads": 4,
207
+ "num_beam_groups": 1,
208
+ "num_beams": 1,
209
+ "num_hidden_layers": 26,
210
+ "num_key_value_heads": 1,
211
+ "num_return_sequences": 1,
212
+ "output_attentions": false,
213
+ "output_hidden_states": false,
214
+ "output_scores": false,
215
+ "pad_token_id": 0,
216
+ "preferred_attn_implementation": "flash_attention_2",
217
+ "prefix": null,
218
+ "problem_type": null,
219
+ "pruned_heads": {},
220
+ "query_pre_attn_scalar": 256,
221
+ "remove_invalid_values": false,
222
+ "repetition_penalty": 1.0,
223
+ "requires_grad": false,
224
+ "return_dict": true,
225
+ "return_dict_in_generate": false,
226
+ "rms_norm_eps": 0.000001,
227
+ "rope_parameters": {
228
+ "full_attention": {
229
+ "factor": 8.0,
230
+ "rope_theta": 1000000,
231
+ "rope_type": "linear"
232
+ },
233
+ "sliding_attention": {
234
+ "rope_theta": 10000,
235
+ "rope_type": "default"
236
+ }
237
+ },
238
+ "sep_token_id": null,
239
+ "sliding_window": 512,
240
+ "suppress_tokens": null,
241
+ "task_specific_params": null,
242
+ "temperature": 1.0,
243
+ "tf_legacy_loss": false,
244
+ "tie_encoder_decoder": false,
245
+ "tie_word_embeddings": true,
246
+ "tokenizer_class": null,
247
+ "top_k": 50,
248
+ "top_p": 1.0,
249
+ "torchscript": false,
250
+ "typical_p": 1.0,
251
+ "use_bfloat16": false,
252
+ "use_bidirectional_attention": false,
253
+ "use_cache": true,
254
+ "vocab_size": 262158
255
+ },
256
+ "text_encoder_lora_config": {
257
+ "alpha": 16.0,
258
+ "dropout": 0.05,
259
+ "enabled": false,
260
+ "freeze_base_model": true,
261
+ "layers": [
262
+ 0,
263
+ 1,
264
+ 2,
265
+ 3,
266
+ 4,
267
+ 5,
268
+ 6,
269
+ 7,
270
+ 8,
271
+ 9,
272
+ 10,
273
+ 11,
274
+ 12,
275
+ 13,
276
+ 14,
277
+ 15,
278
+ 16,
279
+ 17,
280
+ 18,
281
+ 19,
282
+ 20,
283
+ 21,
284
+ 22,
285
+ 23,
286
+ 24,
287
+ 25
288
+ ],
289
+ "merged_into_base": true,
290
+ "rank": 8,
291
+ "target_modules": [
292
+ "q_proj",
293
+ "v_proj",
294
+ "o_proj"
295
+ ]
296
+ },
297
+ "text_encoder_proj_type": "linear",
298
+ "text_encoder_special_tokens_config": {
299
+ "enabled": false,
300
+ "freeze_base_embeddings": true,
301
+ "initializer_token_ids": {
302
+ "<ins_bos>": [
303
+ 236820,
304
+ 22768,
305
+ 236813
306
+ ],
307
+ "<ins_eos>": [
308
+ 954,
309
+ 22768,
310
+ 236813
311
+ ],
312
+ "[S0]": [
313
+ 262146
314
+ ],
315
+ "[S1]": [
316
+ 262147
317
+ ],
318
+ "[S2]": [
319
+ 262148
320
+ ],
321
+ "[S3]": [
322
+ 262149
323
+ ],
324
+ "[S4]": [
325
+ 262150
326
+ ],
327
+ "[S5]": [
328
+ 262151
329
+ ],
330
+ "[S6]": [
331
+ 262152
332
+ ],
333
+ "[S7]": [
334
+ 262153
335
+ ],
336
+ "[S8]": [
337
+ 262154
338
+ ],
339
+ "[S9]": [
340
+ 262155
341
+ ]
342
+ },
343
+ "initializers": {
344
+ "<ins_bos>": "<instruction>",
345
+ "<ins_eos>": "</instruction>",
346
+ "[S0]": "[S0]",
347
+ "[S1]": "[S1]",
348
+ "[S2]": "[S2]",
349
+ "[S3]": "[S3]",
350
+ "[S4]": "[S4]",
351
+ "[S5]": "[S5]",
352
+ "[S6]": "[S6]",
353
+ "[S7]": "[S7]",
354
+ "[S8]": "[S8]",
355
+ "[S9]": "[S9]"
356
+ },
357
+ "instruction_tokens": {
358
+ "bos": "<ins_bos>",
359
+ "eos": "<ins_eos>"
360
+ },
361
+ "merged_into_base": true,
362
+ "num_added_tokens": 12,
363
+ "speaker_tokens": [
364
+ "[S0]",
365
+ "[S1]",
366
+ "[S2]",
367
+ "[S3]",
368
+ "[S4]",
369
+ "[S5]",
370
+ "[S6]",
371
+ "[S7]",
372
+ "[S8]",
373
+ "[S9]"
374
+ ],
375
+ "token_ids": {
376
+ "<ins_bos>": 262156,
377
+ "<ins_eos>": 262157,
378
+ "[S0]": 262146,
379
+ "[S1]": 262147,
380
+ "[S2]": 262148,
381
+ "[S3]": 262149,
382
+ "[S4]": 262150,
383
+ "[S5]": 262151,
384
+ "[S6]": 262152,
385
+ "[S7]": 262153,
386
+ "[S8]": 262154,
387
+ "[S9]": 262155
388
+ },
389
+ "tokens": [
390
+ "[S0]",
391
+ "[S1]",
392
+ "[S2]",
393
+ "[S3]",
394
+ "[S4]",
395
+ "[S5]",
396
+ "[S6]",
397
+ "[S7]",
398
+ "[S8]",
399
+ "[S9]",
400
+ "<ins_bos>",
401
+ "<ins_eos>"
402
+ ],
403
+ "trainable": true
404
+ },
405
+ "text_vocab_size": 262158,
406
+ "tie_codebooks_embeddings": true,
407
+ "tie_word_embeddings": false,
408
+ "transformers_version": "4.57.3",
409
+ "use_cache": true,
410
+ "vocab_size": 2051,
411
+ "backbone_config": {
412
+ "architectures": [
413
+ "Qwen3ForCausalLM"
414
+ ],
415
+ "attention_bias": false,
416
+ "attention_dropout": 0.0,
417
+ "bos_token_id": 151643,
418
+ "eos_token_id": 151645,
419
+ "head_dim": 128,
420
+ "hidden_act": "silu",
421
+ "hidden_size": 2048,
422
+ "initializer_range": 0.02,
423
+ "intermediate_size": 6144,
424
+ "max_position_embeddings": 40960,
425
+ "max_window_layers": 28,
426
+ "model_type": "qwen3",
427
+ "num_attention_heads": 16,
428
+ "num_hidden_layers": 28,
429
+ "num_key_value_heads": 8,
430
+ "rms_norm_eps": 0.000001,
431
+ "rope_scaling": null,
432
+ "rope_theta": 1000000,
433
+ "sliding_window": null,
434
+ "tie_word_embeddings": true,
435
+ "torch_dtype": "bfloat16",
436
+ "transformers_version": "4.51.0",
437
+ "use_cache": true,
438
+ "use_sliding_window": false,
439
+ "vocab_size": 151936
440
+ }
441
+ }
generation_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 2,
3
+ "depth_decoder_do_sample": true,
4
+ "depth_decoder_temperature": 0.9,
5
+ "do_sample": true,
6
+ "eos_token_id": [
7
+ 1
8
+ ],
9
+ "max_new_tokens": 750,
10
+ "pad_token_id": 0,
11
+ "temperature": 0.9,
12
+ "transformers_version": "4.57.3"
13
+ }
model-00001-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abf813781256e10cbe81f2dbb415f897556225d4dfa0282d67aa8ea164e114a9
3
+ size 4961989890
model-00002-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36aa73b1a11361e1774db90d9c63c63303b294c022de112aa51904d940edcef1
3
+ size 2004567152
model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "[S0]",
4
+ "[S1]",
5
+ "[S2]",
6
+ "[S3]",
7
+ "[S4]",
8
+ "[S5]",
9
+ "[S6]",
10
+ "[S7]",
11
+ "[S8]",
12
+ "[S9]",
13
+ "<ins_bos>",
14
+ "<ins_eos>"
15
+ ],
16
+ "bos_token": {
17
+ "content": "<bos>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "eos_token": {
24
+ "content": "<eos>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "mask_token": {
31
+ "content": "<mask>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "pad_token": {
38
+ "content": "<pad>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3ec9ac3eb2392389b9f5112e85d8b43316494addb587ba7b7a9d61eac23af96
3
+ size 33386945
tokenizer_config.json ADDED
The diff for this file is too large to render. See raw diff