Upload hybrid model for hotpotqa (trained on 2000 queries)

README.md

@@ -31,22 +31,22 @@ model-index:
       value: 0.99
       name: Accuracy
     - type: accuracy_threshold
-      value: 0.36488422751426697
+      value: 0.0021620974875986576
       name: Accuracy Threshold
     - type: f1
-      value: 0.9899665551839465
+      value: 0.9900332225913622
       name: F1
     - type: f1_threshold
-      value: 0.36488422751426697
+      value: 0.0011168117634952068
       name: F1 Threshold
     - type: precision
-      value: 0.9932885906040269
+      value: 0.9867549668874173
       name: Precision
     - type: recall
-      value: 0.9866666666666667
+      value: 0.9933333333333333
       name: Recall
     - type: average_precision
-      value: 0.9990750988940835
+      value: 0.9995697171348688
       name: Average Precision
   - task:
       type: cross-encoder-binary-classification
@@ -56,25 +56,25 @@ model-index:
       type: train_subset
     metrics:
     - type: accuracy
-      value: 0.942
+      value: 0.926
       name: Accuracy
     - type: accuracy_threshold
-      value: 0.7960790395736694
+      value: 0.6817218065261841
       name: Accuracy Threshold
     - type: f1
-      value: 0.9436893203883495
+      value: 0.9270216962524654
       name: F1
     - type: f1_threshold
-      value: 0.6639484167098999
+      value: 0.007857910357415676
       name: F1 Threshold
     - type: precision
-      value: 0.9346153846153846
+      value: 0.9288537549407114
       name: Precision
     - type: recall
-      value: 0.9529411764705882
+      value: 0.9251968503937008
       name: Recall
     - type: average_precision
-      value: 0.9846637760303424
+      value: 0.9650983248932256
       name: Average Precision
 ---
 
@@ -118,11 +118,11 @@ from sentence_transformers import CrossEncoder
 model = CrossEncoder("cross_encoder_model_id")
 # Get scores for pairs of texts
 pairs = [
-    ['Who was the writer of the musical for which Edwin Gagiano received his Best Actor Award for the role of Alf Bueller?', "Back to the 80s (musical). Back to the 80's [sic] is a musical written by Neil Gooding with the original musical adaption made by Scott Copeman.  It was later re-orchestrated and arranged by Brett Foster in 2003, just prior to the Australian Production.  It was originally staged by Neil Gooding Productions Pty Ltd in Sydney, Australia in 2004.  It is a popular show for school productions in the English speaking world."],
-    ['Are Stephens Cur and Smooth Collie both herding dogs?', 'Stephens Cur. The Stephens Cur (a.k.a. Stephens\' Stock Cur), is a scent hound that belongs to the Cur dog breed.  They were originally bred by the Stephens family in southeastern Kentucky.  The dogs known as "Little black dog" were bred by generations of that family for over a century.  In 1970, they were recognized as separate and distinct breed of Cur.  The dog is mostly black with white markings, but more than a third white is not permissible.  It is good for hunting raccoon and squirrel, but can also be used to bay wild boar.  They are registered with the United Kennel Club'],
-    ['What was the name of the radio telescope the surpassed the Dwingeloo Radio Observatory?', 'Hoopoe-billed ʻakialoa. The hoopoe-billed ʻakialoa, ("Akialoa upupirostris"), was an extinct species of Hawaiian honeycreeper.  Fossil remains have been found of this species in the Hawaiian islands of Kauai and Oahu.  The species specific name, "upupirostris", is derived from the Latin "upupa", hoopoe, and "rostrum", bill, and refers to the long sickle-shaped bill which resembles that of the hoopoe.  The species was apparently slightly larger than others in its genus.  A similar but smaller bird has been discovered but is as yet undescribed from the island of Maui.  The species presumably became extinct after the arrival of humans in Hawaii, and is known only from the fossil record.'],
-    ['Are both Robert Stevenson and Am Rong a filmmaker?', 'Will Arnett. William Emerson Arnett ( ; born May 4, 1970) is a Canadian-American actor, voice actor and comedian.  He is best known for his role as George Oscar "Gob" Bluth II in the Fox/Netflix series "Arrested Development" (2003–2006, 2013, 2018); as well as his titular role as BoJack Horseman in the Netflix Original Series of the same name (2014-present).  He has appeared in films such as "Blades of Glory" (2007), "Hot Rod" (2007) and "Teenage Mutant Ninja Turtles" (2014).'],
-    ['Who founded this American guitar manufacturer headquartered in Maryland that produced electric baritone guitars?', 'Baritone guitar. The baritone guitar is a guitar with a longer scale length, typically a larger body, and heavier internal bracing, so it can be tuned to a lower pitch.  Gretsch, Fender, Gibson, Ibanez, ESP Guitars, PRS Guitars, Music Man, Danelectro, Schecter, Jerry Jones Guitars, Burns London and many other companies have produced electric baritone guitars since the 1960s, although always in small numbers due to low popularity.  Tacoma, Santa Cruz, Taylor, Martin, Alvarez Guitars and others have made acoustic baritone guitars.'],
+    ['What nationality was the person whose music inspired the Folias Flute and Guitar Duo ?', 'Kenneth Ascher. Kenneth Lee "Kenny" Ascher (born October 26, 1944 in Washington, D.C.) is an American jazz pianist, composer, and arranger who is active in jazz, rock, classical, and musical theater genres — in live venues, recording studios, and cinema production.  He is widely known for co-writing, with Paul Williams, "Rainbow Connection" from "The Muppet Movie".  Both Williams and Ascher received Oscar nominations for the 1979 Academy Awards for Best Original Song ("Rainbow Connection") and Best Original Score ("The Muppet Movie" Soundtrack).  The song was also nominated for the Golden Globes for "Best Original Song" that same year.'],
+    ['Orff Schulwerk was developed by the composer who was best known for what cantata?', 'Isabel McNeill Carley. Isabel McNeill Carley (4 December 1918 – 14 July 2011) was a published writer, editor, composer and music teacher.  She’s considered one of the leaders of the Orff Schulwerk when it began to take hold in the United States in the 1960s.  As a co-founder of the American Orff-Schulwerk Association (AOSA), Carley contributed greatly to the organization’s beginnings, serving as a board member and magazine editor.  Carley devoted much of her life to musical instruction, publishing a series of books titled Recorder Improvisation and Technique.'],
+    ['What country does Pioneer Canal and Orleans Canal have in common?', 'Same-sex marriage in the Sixth Circuit. On April 28, 2015, the Supreme Court of the United States heard oral arguments for "Obergefell v. Hodges" (Ohio), which was consolidated with three other same-sex marriage cases from the other states in the Sixth Circuit: "Tanco v. Haslam" (Tennessee), "DeBoer v. Snyder" (Michigan), "Bourke v. Beshear" (Kentucky).  On June 26, 2015 the Supreme Court reversed the Sixth Circuit\'s decision, paving the way for same-sex marriage to become legal in those states, and setting a precedent for the entire nation.  All four states complied with the ruling the same day it was issued before the mandate was actually issued.  Every state in the circuit had a district court ruling against their states\' ban, but they were eventually stayed pending appeal.  The Sixth Circuit consists of Kentucky, Michigan, Ohio, and Tennessee.  On August 6, 2014, the Sixth Circuit heard oral arguments for same-sex marriage cases from each state within the circuit.  On November 6, 2014, the Sixth Circuit in a split 2-1 decision, upheld the states\' same-sex marriage bans, reversing the district courts\' rulings that struck them down.  The Sixth Circuit was the first and only circuit court since the landmark ruling "United States v. Windsor" to uphold the constitutionality of states\' same-sex marriage bans which caused a circuit split.'],
+    ['In what year was the actor who plays an anxious novelist in the movie Ruby Sparks born?', 'Rufus Sewell. Rufus Frederik Sewell ( ; born 29 October 1967) is an English actor.  In film, he has appeared in Kenneth Branagh\'s rendition of "Hamlet" (1996) playing Fortinbras, "The Woodlanders", "Dangerous Beauty", "Dark City", "A Knight\'s Tale", "The Illusionist", "Tristan and Isolde", and "Martha, Meet Frank, Daniel and Laurence".  On television, he starred as "Obergruppenführer" John Smith in "The Man in the High Castle", an Italian detective in the BBC\'s television series "Zen" (2011) and also appeared in the mini-series "The Pillars of the Earth" (2010).  In 1993 he played the hero, Will Ladislaw, in the BBC\'s adaptation of George Eliot\'s "Middlemarch".  In 2003, he appeared in the lead role in "".  He starred in the CBS drama "Eleventh Hour", which was cancelled in April 2009.  On stage, he originated the role of Septimus Hodge in Tom Stoppard\'s "Arcadia" and the role of Jan in Stoppard\'s "Rock \'n\' Roll"; the latter earned him an Olivier Award and a Tony Award nomination.'],
+    ["Brent Ferrin Ashworth appeared on Beck's special show on collecting, along with a Las Vegas-based businessman and reality television personality who made $2,000 a week selling what?", 'Marlo Stanfield. Marlo Stanfield is a fictional character on the HBO television drama "The Wire", played by actor Jamie Hector.  Stanfield is a young, ambitious, intelligent and extremely ruthless player and is head of the eponymous Stanfield Organization in the Baltimore drug trade.  Marlo\'s organization starts out small-time, operating in the vacuum left by the Barksdale Organization, and rises to the top of the Baltimore drug trade fairly quickly.  A repeated theme in Marlo\'s characterization is his demand for unconditional respect, which trumps all other concerns.  He frequently orders the deaths of those who disrespect him or undermine his name on the streets, however unwittingly.  He is arguably the most violent and ruthless of the drug kingpins portrayed in "The Wire"; In 2016, "Rolling Stone" ranked him #2 of their "40 Greatest TV Villains of All Time".'],
 ]
 scores = model.predict(pairs)
 print(scores.shape)
@@ -130,13 +130,13 @@ print(scores.shape)
 
 # Or rank different texts based on similarity to a single text
 ranks = model.rank(
-    'Who was the writer of the musical for which Edwin Gagiano received his Best Actor Award for the role of Alf Bueller?',
+    'What nationality was the person whose music inspired the Folias Flute and Guitar Duo ?',
     [
-        "Back to the 80s (musical). Back to the 80's [sic] is a musical written by Neil Gooding with the original musical adaption made by Scott Copeman.  It was later re-orchestrated and arranged by Brett Foster in 2003, just prior to the Australian Production.  It was originally staged by Neil Gooding Productions Pty Ltd in Sydney, Australia in 2004.  It is a popular show for school productions in the English speaking world.",
-        'Stephens Cur. The Stephens Cur (a.k.a. Stephens\' Stock Cur), is a scent hound that belongs to the Cur dog breed.  They were originally bred by the Stephens family in southeastern Kentucky.  The dogs known as "Little black dog" were bred by generations of that family for over a century.  In 1970, they were recognized as separate and distinct breed of Cur.  The dog is mostly black with white markings, but more than a third white is not permissible.  It is good for hunting raccoon and squirrel, but can also be used to bay wild boar.  They are registered with the United Kennel Club',
-        'Hoopoe-billed ʻakialoa. The hoopoe-billed ʻakialoa, ("Akialoa upupirostris"), was an extinct species of Hawaiian honeycreeper.  Fossil remains have been found of this species in the Hawaiian islands of Kauai and Oahu.  The species specific name, "upupirostris", is derived from the Latin "upupa", hoopoe, and "rostrum", bill, and refers to the long sickle-shaped bill which resembles that of the hoopoe.  The species was apparently slightly larger than others in its genus.  A similar but smaller bird has been discovered but is as yet undescribed from the island of Maui.  The species presumably became extinct after the arrival of humans in Hawaii, and is known only from the fossil record.',
-        'Will Arnett. William Emerson Arnett ( ; born May 4, 1970) is a Canadian-American actor, voice actor and comedian.  He is best known for his role as George Oscar "Gob" Bluth II in the Fox/Netflix series "Arrested Development" (2003–2006, 2013, 2018); as well as his titular role as BoJack Horseman in the Netflix Original Series of the same name (2014-present).  He has appeared in films such as "Blades of Glory" (2007), "Hot Rod" (2007) and "Teenage Mutant Ninja Turtles" (2014).',
-        'Baritone guitar. The baritone guitar is a guitar with a longer scale length, typically a larger body, and heavier internal bracing, so it can be tuned to a lower pitch.  Gretsch, Fender, Gibson, Ibanez, ESP Guitars, PRS Guitars, Music Man, Danelectro, Schecter, Jerry Jones Guitars, Burns London and many other companies have produced electric baritone guitars since the 1960s, although always in small numbers due to low popularity.  Tacoma, Santa Cruz, Taylor, Martin, Alvarez Guitars and others have made acoustic baritone guitars.',
+        'Kenneth Ascher. Kenneth Lee "Kenny" Ascher (born October 26, 1944 in Washington, D.C.) is an American jazz pianist, composer, and arranger who is active in jazz, rock, classical, and musical theater genres — in live venues, recording studios, and cinema production.  He is widely known for co-writing, with Paul Williams, "Rainbow Connection" from "The Muppet Movie".  Both Williams and Ascher received Oscar nominations for the 1979 Academy Awards for Best Original Song ("Rainbow Connection") and Best Original Score ("The Muppet Movie" Soundtrack).  The song was also nominated for the Golden Globes for "Best Original Song" that same year.',
+        'Isabel McNeill Carley. Isabel McNeill Carley (4 December 1918 – 14 July 2011) was a published writer, editor, composer and music teacher.  She’s considered one of the leaders of the Orff Schulwerk when it began to take hold in the United States in the 1960s.  As a co-founder of the American Orff-Schulwerk Association (AOSA), Carley contributed greatly to the organization’s beginnings, serving as a board member and magazine editor.  Carley devoted much of her life to musical instruction, publishing a series of books titled Recorder Improvisation and Technique.',
+        'Same-sex marriage in the Sixth Circuit. On April 28, 2015, the Supreme Court of the United States heard oral arguments for "Obergefell v. Hodges" (Ohio), which was consolidated with three other same-sex marriage cases from the other states in the Sixth Circuit: "Tanco v. Haslam" (Tennessee), "DeBoer v. Snyder" (Michigan), "Bourke v. Beshear" (Kentucky).  On June 26, 2015 the Supreme Court reversed the Sixth Circuit\'s decision, paving the way for same-sex marriage to become legal in those states, and setting a precedent for the entire nation.  All four states complied with the ruling the same day it was issued before the mandate was actually issued.  Every state in the circuit had a district court ruling against their states\' ban, but they were eventually stayed pending appeal.  The Sixth Circuit consists of Kentucky, Michigan, Ohio, and Tennessee.  On August 6, 2014, the Sixth Circuit heard oral arguments for same-sex marriage cases from each state within the circuit.  On November 6, 2014, the Sixth Circuit in a split 2-1 decision, upheld the states\' same-sex marriage bans, reversing the district courts\' rulings that struck them down.  The Sixth Circuit was the first and only circuit court since the landmark ruling "United States v. Windsor" to uphold the constitutionality of states\' same-sex marriage bans which caused a circuit split.',
+        'Rufus Sewell. Rufus Frederik Sewell ( ; born 29 October 1967) is an English actor.  In film, he has appeared in Kenneth Branagh\'s rendition of "Hamlet" (1996) playing Fortinbras, "The Woodlanders", "Dangerous Beauty", "Dark City", "A Knight\'s Tale", "The Illusionist", "Tristan and Isolde", and "Martha, Meet Frank, Daniel and Laurence".  On television, he starred as "Obergruppenführer" John Smith in "The Man in the High Castle", an Italian detective in the BBC\'s television series "Zen" (2011) and also appeared in the mini-series "The Pillars of the Earth" (2010).  In 1993 he played the hero, Will Ladislaw, in the BBC\'s adaptation of George Eliot\'s "Middlemarch".  In 2003, he appeared in the lead role in "".  He starred in the CBS drama "Eleventh Hour", which was cancelled in April 2009.  On stage, he originated the role of Septimus Hodge in Tom Stoppard\'s "Arcadia" and the role of Jan in Stoppard\'s "Rock \'n\' Roll"; the latter earned him an Olivier Award and a Tony Award nomination.',
+        'Marlo Stanfield. Marlo Stanfield is a fictional character on the HBO television drama "The Wire", played by actor Jamie Hector.  Stanfield is a young, ambitious, intelligent and extremely ruthless player and is head of the eponymous Stanfield Organization in the Baltimore drug trade.  Marlo\'s organization starts out small-time, operating in the vacuum left by the Barksdale Organization, and rises to the top of the Baltimore drug trade fairly quickly.  A repeated theme in Marlo\'s characterization is his demand for unconditional respect, which trumps all other concerns.  He frequently orders the deaths of those who disrespect him or undermine his name on the streets, however unwittingly.  He is arguably the most violent and ruthless of the drug kingpins portrayed in "The Wire"; In 2016, "Rolling Stone" ranked him #2 of their "40 Greatest TV Villains of All Time".',
     ]
 )
 # [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]
@@ -177,13 +177,13 @@ You can finetune this model on your own dataset.
 
 | Metric                | validation | train_subset |
 |:----------------------|:-----------|:-------------|
-| accuracy              | 0.99       | 0.942        |
-| accuracy_threshold    | 0.3649     | 0.7961       |
-| f1                    | 0.99       | 0.9437       |
-| f1_threshold          | 0.3649     | 0.6639       |
-| precision             | 0.9933     | 0.9346       |
-| recall                | 0.9867     | 0.9529       |
-| **average_precision** | **0.9991** | **0.9847**   |
+| accuracy              | 0.99       | 0.926        |
+| accuracy_threshold    | 0.0022     | 0.6817       |
+| f1                    | 0.99       | 0.927        |
+| f1_threshold          | 0.0011     | 0.0079       |
+| precision             | 0.9868     | 0.9289       |
+| recall                | 0.9933     | 0.9252       |
+| **average_precision** | **0.9996** | **0.9651**   |
 
 <!--
 ## Bias, Risks and Limitations
@@ -206,16 +206,16 @@ You can finetune this model on your own dataset.
 * Size: 8,000 training samples
 * Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
 * Approximate statistics based on the first 1000 samples:
-  |         | sentence_0                                                                                       | sentence_1                                                                                        | label                                                         |
-  |:--------|:-------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------|:--------------------------------------------------------------|
-  | type    | string                                                                                           | string                                                                                            | float                                                         |
-  | details | <ul><li>min: 23 characters</li><li>mean: 104.78 characters</li><li>max: 498 characters</li></ul> | <ul><li>min: 79 characters</li><li>mean: 541.67 characters</li><li>max: 2408 characters</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.5</li><li>max: 1.0</li></ul> |
+  |         | sentence_0                                                                                       | sentence_1                                                                                        | label                                                          |
+  |:--------|:-------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------|:---------------------------------------------------------------|
+  | type    | string                                                                                           | string                                                                                            | float                                                          |
+  | details | <ul><li>min: 35 characters</li><li>mean: 104.32 characters</li><li>max: 474 characters</li></ul> | <ul><li>min: 92 characters</li><li>mean: 537.42 characters</li><li>max: 2340 characters</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.51</li><li>max: 1.0</li></ul> |
 * Samples:
-  | sentence_0                                                                                                                        | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        | label            |
-  |:----------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
-  | <code>Who was the writer of the musical for which Edwin Gagiano received his Best Actor Award for the role of Alf Bueller?</code> | <code>Back to the 80s (musical). Back to the 80's [sic] is a musical written by Neil Gooding with the original musical adaption made by Scott Copeman.  It was later re-orchestrated and arranged by Brett Foster in 2003, just prior to the Australian Production.  It was originally staged by Neil Gooding Productions Pty Ltd in Sydney, Australia in 2004.  It is a popular show for school productions in the English speaking world.</code>                                                                                                                                                                                                                                                                                | <code>1.0</code> |
-  | <code>Are Stephens Cur and Smooth Collie both herding dogs?</code>                                                                | <code>Stephens Cur. The Stephens Cur (a.k.a. Stephens' Stock Cur), is a scent hound that belongs to the Cur dog breed.  They were originally bred by the Stephens family in southeastern Kentucky.  The dogs known as "Little black dog" were bred by generations of that family for over a century.  In 1970, they were recognized as separate and distinct breed of Cur.  The dog is mostly black with white markings, but more than a third white is not permissible.  It is good for hunting raccoon and squirrel, but can also be used to bay wild boar.  They are registered with the United Kennel Club</code>                                                                                                             | <code>1.0</code> |
-  | <code>What was the name of the radio telescope the surpassed the Dwingeloo Radio Observatory?</code>                              | <code>Hoopoe-billed ʻakialoa. The hoopoe-billed ʻakialoa, ("Akialoa upupirostris"), was an extinct species of Hawaiian honeycreeper.  Fossil remains have been found of this species in the Hawaiian islands of Kauai and Oahu.  The species specific name, "upupirostris", is derived from the Latin "upupa", hoopoe, and "rostrum", bill, and refers to the long sickle-shaped bill which resembles that of the hoopoe.  The species was apparently slightly larger than others in its genus.  A similar but smaller bird has been discovered but is as yet undescribed from the island of Maui.  The species presumably became extinct after the arrival of humans in Hawaii, and is known only from the fossil record.</code> | <code>0.0</code> |
+  | sentence_0                                                                                          | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | label            |
+  |:----------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
+  | <code>What nationality was the person whose music inspired the Folias Flute and Guitar Duo ?</code> | <code>Kenneth Ascher. Kenneth Lee "Kenny" Ascher (born October 26, 1944 in Washington, D.C.) is an American jazz pianist, composer, and arranger who is active in jazz, rock, classical, and musical theater genres — in live venues, recording studios, and cinema production.  He is widely known for co-writing, with Paul Williams, "Rainbow Connection" from "The Muppet Movie".  Both Williams and Ascher received Oscar nominations for the 1979 Academy Awards for Best Original Song ("Rainbow Connection") and Best Original Score ("The Muppet Movie" Soundtrack).  The song was also nominated for the Golden Globes for "Best Original Song" that same year.</code>                                                                                                                                                                                                                                                                                                                                                                         | <code>0.0</code> |
+  | <code>Orff Schulwerk was developed by the composer who was best known for what cantata?</code>      | <code>Isabel McNeill Carley. Isabel McNeill Carley (4 December 1918 – 14 July 2011) was a published writer, editor, composer and music teacher.  She’s considered one of the leaders of the Orff Schulwerk when it began to take hold in the United States in the 1960s.  As a co-founder of the American Orff-Schulwerk Association (AOSA), Carley contributed greatly to the organization’s beginnings, serving as a board member and magazine editor.  Carley devoted much of her life to musical instruction, publishing a series of books titled Recorder Improvisation and Technique.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                       | <code>0.0</code> |
+  | <code>What country does Pioneer Canal and Orleans Canal have in common?</code>                      | <code>Same-sex marriage in the Sixth Circuit. On April 28, 2015, the Supreme Court of the United States heard oral arguments for "Obergefell v. Hodges" (Ohio), which was consolidated with three other same-sex marriage cases from the other states in the Sixth Circuit: "Tanco v. Haslam" (Tennessee), "DeBoer v. Snyder" (Michigan), "Bourke v. Beshear" (Kentucky).  On June 26, 2015 the Supreme Court reversed the Sixth Circuit's decision, paving the way for same-sex marriage to become legal in those states, and setting a precedent for the entire nation.  All four states complied with the ruling the same day it was issued before the mandate was actually issued.  Every state in the circuit had a district court ruling against their states' ban, but they were eventually stayed pending appeal.  The Sixth Circuit consists of Kentucky, Michigan, Ohio, and Tennessee.  On August 6, 2014, the Sixth Circuit heard oral arguments for same-sex marriage cases from each state within the circuit.  On November 6, 2...</code> | <code>0.0</code> |
 * Loss: [<code>BinaryCrossEntropyLoss</code>](https://sbert.net/docs/package_reference/cross_encoder/losses.html#binarycrossentropyloss) with these parameters:
   ```json
   {
@@ -352,19 +352,22 @@ You can finetune this model on your own dataset.
 </details>
 
 ### Training Logs
-| Epoch | Step | validation_average_precision | train_subset_average_precision |
-|:-----:|:----:|:----------------------------:|:------------------------------:|
-| 0.025 | 100  | 0.9994                       | 0.9911                         |
-| 0.05  | 200  | 0.9983                       | 0.9895                         |
-| 0.075 | 300  | 0.9981                       | 0.9887                         |
-| 0.1   | 400  | 0.9991                       | 0.9847                         |
+| Epoch | Step | Training Loss | validation_average_precision | train_subset_average_precision |
+|:-----:|:----:|:-------------:|:----------------------------:|:------------------------------:|
+| 0.025 | 100  | -             | 0.9988                       | 0.9757                         |
+| 0.05  | 200  | -             | 0.9992                       | 0.9766                         |
+| 0.075 | 300  | -             | 0.9997                       | 0.9806                         |
+| 0.1   | 400  | -             | 0.9997                       | 0.8754                         |
+| 0.125 | 500  | 0.4041        | 0.9997                       | 0.9600                         |
+| 0.15  | 600  | -             | 0.9995                       | 0.9732                         |
+| 0.175 | 700  | -             | 0.9996                       | 0.9651                         |
 
 
 ### Framework Versions
 - Python: 3.11.13
-- Sentence Transformers: 5.2.0
+- Sentence Transformers: 5.2.2
 - Transformers: 4.44.2
-- PyTorch: 2.9.1+cu128
+- PyTorch: 2.10.0+cu128
 - Accelerate: 1.12.0
 - Datasets: 4.0.0
 - Tokenizers: 0.19.1

config.json

@@ -28,7 +28,7 @@
   "position_embedding_type": "absolute",
   "sentence_transformers": {
     "activation_fn": "torch.nn.modules.activation.Sigmoid",
-    "version": "5.2.0"
+    "version": "5.2.2"
   },
   "torch_dtype": "float32",
   "transformers_version": "4.44.2",

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:83e437d53fd5c0d6d32f6e33f5663924619f9fb021b634853cac3b100f1de52f
+oid sha256:32c6c440cedb9d2e88aa61031dd79dd7a0c56e29cd72b3c1c1bde9f225a0e292
 size 2271071852