Instructions to use tasksource/ModernBERT-base-embed with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use tasksource/ModernBERT-base-embed with sentence-transformers:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("tasksource/ModernBERT-base-embed")

sentences = [
"Daniel went to the kitchen. Sandra went back to the kitchen. Daniel moved to the garden. Sandra grabbed the apple. Sandra went back to the office. Sandra dropped the apple. Sandra went to the garden. Sandra went back to the bedroom. Sandra went back to the office. Mary went back to the office. Daniel moved to the bathroom. Sandra grabbed the apple. Sandra travelled to the garden. Sandra put down the apple there. Mary went back to the bathroom. Daniel travelled to the garden. Mary took the milk. Sandra grabbed the apple. Mary left the milk there. Sandra journeyed to the bedroom. John travelled to the office. John went back to the garden. Sandra journeyed to the garden. Mary grabbed the milk. Mary left the milk. Mary grabbed the milk. Mary went to the hallway. John moved to the hallway. Mary picked up the football. Sandra journeyed to the kitchen. Sandra left the apple. Mary discarded the milk. John journeyed to the garden. Mary dropped the football. Daniel moved to the bathroom. Daniel journeyed to the kitchen. Mary travelled to the bathroom. Daniel went to the bedroom. Mary went to the hallway. Sandra got the apple. Sandra went back to the hallway. Mary moved to the kitchen. Sandra dropped the apple there. Sandra grabbed the milk. Sandra journeyed to the bathroom. John went back to the kitchen. Sandra went to the kitchen. Sandra travelled to the bathroom. Daniel went to the garden. Daniel moved to the kitchen. Sandra dropped the milk. Sandra got the milk. Sandra put down the milk. John journeyed to the garden. Sandra went back to the hallway. Sandra picked up the apple. Sandra got the football. Sandra moved to the garden. Daniel moved to the bathroom. Daniel travelled to the garden. Sandra went back to the bathroom. Sandra discarded the football.",
"In the adulthood stage, it can jump, walk, run",
"The chocolate is bigger than the container.",
"The football before the bathroom was in the garden."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]

Notebooks
Google Colab
Kaggle

sileod commited on Dec 27, 2024

Commit

3b0d1a4

verified ·

1 Parent(s): 0a60567

Update README.md

Browse files

Files changed (1) hide show

README.md +89 -77

README.md CHANGED Viewed

@@ -11,45 +11,50 @@ tags:
 - loss:CachedMultipleNegativesRankingLoss
 - loss:SoftmaxLoss
 - loss:CosineSimilarityLoss
-base_model: tasksource/ModernBERT-base-nli
 widget:
-- source_sentence: Daniel went to the kitchen. Sandra went back to the kitchen. Daniel
-    moved to the garden. Sandra grabbed the apple. Sandra went back to the office.
-    Sandra dropped the apple. Sandra went to the garden. Sandra went back to the bedroom.
-    Sandra went back to the office. Mary went back to the office. Daniel moved to
-    the bathroom. Sandra grabbed the apple. Sandra travelled to the garden. Sandra
-    put down the apple there. Mary went back to the bathroom. Daniel travelled to
-    the garden. Mary took the milk. Sandra grabbed the apple. Mary left the milk there.
-    Sandra journeyed to the bedroom. John travelled to the office. John went back
-    to the garden. Sandra journeyed to the garden. Mary grabbed the milk. Mary left
-    the milk. Mary grabbed the milk. Mary went to the hallway. John moved to the hallway.
-    Mary picked up the football. Sandra journeyed to the kitchen. Sandra left the
-    apple. Mary discarded the milk. John journeyed to the garden. Mary dropped the
-    football. Daniel moved to the bathroom. Daniel journeyed to the kitchen. Mary
-    travelled to the bathroom. Daniel went to the bedroom. Mary went to the hallway.
-    Sandra got the apple. Sandra went back to the hallway. Mary moved to the kitchen.
-    Sandra dropped the apple there. Sandra grabbed the milk. Sandra journeyed to the
-    bathroom. John went back to the kitchen. Sandra went to the kitchen. Sandra travelled
-    to the bathroom. Daniel went to the garden. Daniel moved to the kitchen. Sandra
-    dropped the milk. Sandra got the milk. Sandra put down the milk. John journeyed
-    to the garden. Sandra went back to the hallway. Sandra picked up the apple. Sandra
-    got the football. Sandra moved to the garden. Daniel moved to the bathroom. Daniel
-    travelled to the garden. Sandra went back to the bathroom. Sandra discarded the
-    football.
   sentences:
   - In the adulthood stage, it can jump, walk, run
   - The chocolate is bigger than the container.
   - The football before the bathroom was in the garden.
-- source_sentence: 'Context: I am devasted.
     Speaker 1: I am very devastated these days.
     Speaker 2: That seems bad and I am sorry to hear that. What happened?
-    Speaker 1: My father day 3 weeks ago.I still can''t believe.
-    Speaker 2: I am truly sorry to hear that. Please accept my apologies for your
-    loss. May he rest in peace'
   sentences:
   - 'The main emotion of this example dialogue is: content'
   - 'This text is about: genealogy'
@@ -66,55 +71,62 @@ widget:
   - My opinion is to wait until the child itself expresses a desire for this.
 - source_sentence: Francis I of France was a king.
   sentences:
-  - The Apple QuickTake -LRB- codenamed Venus , Mars , Neptune -RRB- is one of the
-    first consumer digital camera lines .. digital camera. digital camera. It was
-    launched in 1994 by Apple Computer and was marketed for three years before being
-    discontinued in 1997 .. Apple Computer. Apple Computer. Three models of the product
-    were built including the 100 and 150 , both built by Kodak ; and the 200 , built
-    by Fujifilm .. Kodak. Kodak. Fujifilm. Fujifilm. The QuickTake cameras had a resolution
-    of 640 x 480 pixels maximum -LRB- 0.3 Mpx -RRB- .. resolution. Display resolution.
-    The 200 model is only officially compatible with the Apple Macintosh for direct
-    connections , while the 100 and 150 model are compatible with both the Apple Macintosh
-    and Microsoft Windows .. Apple Macintosh. Apple Macintosh. Microsoft Windows.
-    Microsoft Windows. Because the QuickTake 200 is almost identical to the Fuji DS-7
-    or to Samsung 's Kenox SSC-350N , Fuji 's software for that camera can be used
-    to gain Windows compatibility for the QuickTake 200 .. Some other software replacements
-    also exist as well as using an external reader for the removable media of the
-    QuickTake 200 .. Time Magazine profiled QuickTake as `` the first consumer digital
-    camera '' and ranked it among its `` 100 greatest and most influential gadgets
-    from 1923 to the present '' list .. digital camera. digital camera. Time Magazine.
-    Time Magazine. While the QuickTake was probably the first digicam to have wide
-    success , technically this is not true as the greyscale Dycam Model 1 -LRB- also
-    marketed as the Logitech FotoMan -RRB- was the first consumer digital camera to
-    be sold in the US in November 1990 .. digital camera. digital camera. greyscale.
-    greyscale. At least one other camera , the Fuji DS-X , was sold in Japan even
-    earlier , in late 1989 .
-  - The ganglion cell layer -LRB- ganglionic layer -RRB- is a layer of the retina
-    that consists of retinal ganglion cells and displaced amacrine cells .. retina.
-    retina. In the macula lutea , the layer forms several strata .. macula lutea.
-    macula lutea. The cells are somewhat flask-shaped ; the rounded internal surface
-    of each resting on the stratum opticum , and sending off an axon which is prolonged
-    into it .. flask. Laboratory flask. stratum opticum. stratum opticum. axon. axon.
-    From the opposite end numerous dendrites extend into the inner plexiform layer
-    , where they branch and form flattened arborizations at different levels .. inner
-    plexiform layer. inner plexiform layer. arborizations. arborizations. dendrites.
-    dendrites. The ganglion cells vary much in size , and the dendrites of the smaller
-    ones as a rule arborize in the inner plexiform layer as soon as they enter it
-    ; while those of the larger cells ramify close to the inner nuclear layer .. inner
-    plexiform layer. inner plexiform layer. dendrites. dendrites. inner nuclear layer.
-    inner nuclear layer
-  - Coyote was a brand of racing chassis designed and built for the use of A. J. Foyt
-    's race team in USAC Championship car racing including the Indianapolis 500 ..
-    A. J. Foyt. A. J. Foyt. USAC. United States Auto Club. Championship car. American
-    Championship car racing. Indianapolis 500. Indianapolis 500. It was used from
-    1966 to 1983 with Foyt himself making 141 starts in the car , winning 25 times
-    .. George Snider had the second most starts with 24 .. George Snider. George Snider.
-    Jim McElreath has the only other win with a Coyote chassis .. Jim McElreath. Jim
-    McElreath. Foyt drove a Coyote to victory in the Indy 500 in 1967 and 1977 ..
-    With Foyt 's permission , fellow Indy 500 champion Eddie Cheever 's Cheever Racing
-    began using the Coyote name for his new Daytona Prototype chassis , derived from
-    the Fabcar chassis design that he had purchased the rights to in 2007 .. Eddie
-    Cheever. Eddie Cheever. Cheever Racing. Cheever Racing. Daytona Prototype. Daytona
     Prototype
 datasets:
 - tomaarsen/natural-questions-hard-negatives

 - loss:CachedMultipleNegativesRankingLoss
 - loss:SoftmaxLoss
 - loss:CosineSimilarityLoss
+base_model:
+- tasksource/ModernBERT-base-nli
+- answerdotai/ModernBERT-base
 widget:
+- source_sentence: >-
+    Daniel went to the kitchen. Sandra went back to the kitchen. Daniel moved to
+    the garden. Sandra grabbed the apple. Sandra went back to the office. Sandra
+    dropped the apple. Sandra went to the garden. Sandra went back to the
+    bedroom. Sandra went back to the office. Mary went back to the office.
+    Daniel moved to the bathroom. Sandra grabbed the apple. Sandra travelled to
+    the garden. Sandra put down the apple there. Mary went back to the bathroom.
+    Daniel travelled to the garden. Mary took the milk. Sandra grabbed the
+    apple. Mary left the milk there. Sandra journeyed to the bedroom. John
+    travelled to the office. John went back to the garden. Sandra journeyed to
+    the garden. Mary grabbed the milk. Mary left the milk. Mary grabbed the
+    milk. Mary went to the hallway. John moved to the hallway. Mary picked up
+    the football. Sandra journeyed to the kitchen. Sandra left the apple. Mary
+    discarded the milk. John journeyed to the garden. Mary dropped the football.
+    Daniel moved to the bathroom. Daniel journeyed to the kitchen. Mary
+    travelled to the bathroom. Daniel went to the bedroom. Mary went to the
+    hallway. Sandra got the apple. Sandra went back to the hallway. Mary moved
+    to the kitchen. Sandra dropped the apple there. Sandra grabbed the milk.
+    Sandra journeyed to the bathroom. John went back to the kitchen. Sandra went
+    to the kitchen. Sandra travelled to the bathroom. Daniel went to the garden.
+    Daniel moved to the kitchen. Sandra dropped the milk. Sandra got the milk.
+    Sandra put down the milk. John journeyed to the garden. Sandra went back to
+    the hallway. Sandra picked up the apple. Sandra got the football. Sandra
+    moved to the garden. Daniel moved to the bathroom. Daniel travelled to the
+    garden. Sandra went back to the bathroom. Sandra discarded the football.
   sentences:
   - In the adulthood stage, it can jump, walk, run
   - The chocolate is bigger than the container.
   - The football before the bathroom was in the garden.
+- source_sentence: >-
+    Context: I am devasted.
     Speaker 1: I am very devastated these days.
     Speaker 2: That seems bad and I am sorry to hear that. What happened?
+    Speaker 1: My father day 3 weeks ago.I still can't believe.
+    Speaker 2: I am truly sorry to hear that. Please accept my apologies for
+    your loss. May he rest in peace
   sentences:
   - 'The main emotion of this example dialogue is: content'
   - 'This text is about: genealogy'
   - My opinion is to wait until the child itself expresses a desire for this.
 - source_sentence: Francis I of France was a king.
   sentences:
+  - >-
+    The Apple QuickTake -LRB- codenamed Venus , Mars , Neptune -RRB- is one of
+    the first consumer digital camera lines .. digital camera. digital camera.
+    It was launched in 1994 by Apple Computer and was marketed for three years
+    before being discontinued in 1997 .. Apple Computer. Apple Computer. Three
+    models of the product were built including the 100 and 150 , both built by
+    Kodak ; and the 200 , built by Fujifilm .. Kodak. Kodak. Fujifilm. Fujifilm.
+    The QuickTake cameras had a resolution of 640 x 480 pixels maximum -LRB- 0.3
+    Mpx -RRB- .. resolution. Display resolution. The 200 model is only
+    officially compatible with the Apple Macintosh for direct connections ,
+    while the 100 and 150 model are compatible with both the Apple Macintosh and
+    Microsoft Windows .. Apple Macintosh. Apple Macintosh. Microsoft Windows.
+    Microsoft Windows. Because the QuickTake 200 is almost identical to the Fuji
+    DS-7 or to Samsung 's Kenox SSC-350N , Fuji 's software for that camera can
+    be used to gain Windows compatibility for the QuickTake 200 .. Some other
+    software replacements also exist as well as using an external reader for the
+    removable media of the QuickTake 200 .. Time Magazine profiled QuickTake as
+    `` the first consumer digital camera '' and ranked it among its `` 100
+    greatest and most influential gadgets from 1923 to the present '' list ..
+    digital camera. digital camera. Time Magazine. Time Magazine. While the
+    QuickTake was probably the first digicam to have wide success , technically
+    this is not true as the greyscale Dycam Model 1 -LRB- also marketed as the
+    Logitech FotoMan -RRB- was the first consumer digital camera to be sold in
+    the US in November 1990 .. digital camera. digital camera. greyscale.
+    greyscale. At least one other camera , the Fuji DS-X , was sold in Japan
+    even earlier , in late 1989 .
+  - >-
+    The ganglion cell layer -LRB- ganglionic layer -RRB- is a layer of the
+    retina that consists of retinal ganglion cells and displaced amacrine cells
+    .. retina. retina. In the macula lutea , the layer forms several strata ..
+    macula lutea. macula lutea. The cells are somewhat flask-shaped ; the
+    rounded internal surface of each resting on the stratum opticum , and
+    sending off an axon which is prolonged into it .. flask. Laboratory flask.
+    stratum opticum. stratum opticum. axon. axon. From the opposite end numerous
+    dendrites extend into the inner plexiform layer , where they branch and form
+    flattened arborizations at different levels .. inner plexiform layer. inner
+    plexiform layer. arborizations. arborizations. dendrites. dendrites. The
+    ganglion cells vary much in size , and the dendrites of the smaller ones as
+    a rule arborize in the inner plexiform layer as soon as they enter it ;
+    while those of the larger cells ramify close to the inner nuclear layer ..
+    inner plexiform layer. inner plexiform layer. dendrites. dendrites. inner
+    nuclear layer. inner nuclear layer
+  - >-
+    Coyote was a brand of racing chassis designed and built for the use of A. J.
+    Foyt 's race team in USAC Championship car racing including the Indianapolis
+    500 .. A. J. Foyt. A. J. Foyt. USAC. United States Auto Club. Championship
+    car. American Championship car racing. Indianapolis 500. Indianapolis 500.
+    It was used from 1966 to 1983 with Foyt himself making 141 starts in the car
+    , winning 25 times .. George Snider had the second most starts with 24 ..
+    George Snider. George Snider. Jim McElreath has the only other win with a
+    Coyote chassis .. Jim McElreath. Jim McElreath. Foyt drove a Coyote to
+    victory in the Indy 500 in 1967 and 1977 .. With Foyt 's permission , fellow
+    Indy 500 champion Eddie Cheever 's Cheever Racing began using the Coyote
+    name for his new Daytona Prototype chassis , derived from the Fabcar chassis
+    design that he had purchased the rights to in 2007 .. Eddie Cheever. Eddie
+    Cheever. Cheever Racing. Cheever Racing. Daytona Prototype. Daytona
     Prototype
 datasets:
 - tomaarsen/natural-questions-hard-negatives