sparcol-large-k2048 / README.md
charsiu's picture
Upload checkpoints from checkpoint-12652
645ac88 verified
metadata
tags:
  - sentence-transformers
  - sparse-encoder
  - sparse
  - generated_from_trainer
  - dataset_size:202427
  - loss:SpladeColbertTopKLoss
  - loss:FlopsLoss
widget:
  - text: >-
      I work on the phone all day long. 90% of my job is cold calling and trying
      to open new accounts. This book helped me understand my own numbers better
      so that I know how many people I need to qualify in order to get an
      account open. It also showed me how a simple question can change the whole
      dynamic of a phone conversation.  Last week I cold called a firm and the
      decision maker was not super excited by the end of our conversation but
      she at least agreed to accept some literature from me in the mail. This
      week I called her back to follow up after reading the chapter on asking
      the right questions that will spark a response from the prospect and get
      an actual conversation started. I asked her how long she had been using
      her current provider and if she has ever compared against another firm to
      see if she is getting the best value for her money. I found out that she
      has been using her current provider since the winter and has never taken a
      look at another option since switching to them. I also found out the
      reasons she chose to use her current provider which gave me a very clear
      understanding of what I need to do in order to earn her business. We
      compared services and she was very surprised to find out that we can save
      her a significant amount of money and also speed up her process as well.
      By the end of the conversation she was calling me by my first name and the
      account should open sometime within the next two weeks. All I can say is
      that this is a great book and I can't wait to read it a second time. Just
      make sure that you put his recommendations to use.  Update: I've continued
      to use the advice in this book and I can sincerely tell you that the
      quality of my calls have CLEARLY increased. I would say that about 75% of
      the people I talk to now I actually have meaningful conversations with. My
      calls went from me trying to convince and barely letting the prospect talk
      to now actual conversations that make the prospect feel like I'm calling
      to really help them. I used to collect only about half of the information
      that I wanted from a prospect. Now, on most of my calls I collect 100% of
      the information I wanted and then some. Great book. I can't wait until the
      actual accounts start opening, which I am more confident that ever before
      that they will. I'll post another update when I open my next account.
  - text: >-
      I received the Xtrema 2 1/2 qt. saucepot as a gift recently and I love
      it.  I already have 3 smaller pots and a teapotle, all of which I've been
      using daily for the last couple years.  This bigger pot is a great
      addition- it's especially useful when I'm cooking for more than 2 people. 
      Otherwise, my 1 1/4 qt (I have 2 of those since I use them so often) or 16
      oz saucepots are usually the right size when cooking for just 1 or 2
      people.  One thing I like about Xtrema cookware is that it's non-toxic and
      metal-free.  It's ceramic so doesn't leach metals (or anything else as far
      as we know!) like metal pans can.  It's a relief to no longer have a funny
      metallic taste in my food like I sometimes did from my stainless steel
      pans.  Leaching metal generally isn't healthy for anyone, but I also want
      to avoid it because I'm allergic to components of stainless steel
      (including nickel, which is a common allergen, especially in women).  So
      Xtrema won't aggravate my metal allergies.  And there's not any toxic
      non-stick material getting into food or producing fumes.  I also like how
      lightweight Xtrema is, much easier for me to lift and manage than my other
      pans (my other pans are Le Creuset enameled cast iron, which I also love,
      but they are very different from Xtrema).  You do have to handle Xtrema a
      bit differently than other pans.  For example, I use it on an electric
      glasstop range, so I have to heat the burner on low for 20 seconds before
      putting the pot on (I think that's to prevent thermal shock from the
      initial intense heat when the range first starts up).  You're not supposed
      to stack the pots because they may break, and I don't slide the pots (any
      pots) on my glasstop, and the glasstop still looks fine.  Otherwise I'm
      not too gentle on my Xtrema, and they seem pretty sturdy.  Xtrema's easy
      to clean, too- if any food is stuck, I briefly soak, then do a quick scrub
      in soapy water.  If there's something stubborn stuck then baking soda does
      the trick.  I'd say Xtrema heats quickly and cooks pretty fast, and it
      also retains the heat, so I use a lower heat than I would with pans such
      as stainless steel.  I find it can cook a bit unevenly or burn food if the
      heat gets too high or you don't keep an eye on it, so it takes a bit of
      practice.  I use my Xtrema for doing things like sauteeing or blanching
      veggies, making soup or chili.  In comparison, I tend to prefer my Le
      Creuset for making oatmeal or slowly braising chicken (for a slow steady
      even heat).  Xtrema is perfectly capable of also making great oatmeal,
      braised chicken, etc., but sometimes it's a little easier for me to use my
      Le Creuset for that (I don't have to watch the Le Creuset as closely, but
      the trade off is that LC is slower, heavier, and not quite as easy to
      handle for me).  Well, it's good to have some variety...  Overall, Xtrema
      is really good, non-toxic cookware, and I recommend it.
  - text: >-
      There are four zoom lenses in the Olympus 4/3 line up that covers the
      standard zoom range.  Standard Grade (SG)Olympus Zuiko Digital ED 14-42mm
      f/3.5-5.6, High Grade (HG)Olympus 14-54mm f/2.8-3.5 II, HGOlympus Zuiko
      12-60mm f/2.8-4.0 Digital ED SWD, and Super High Grade (SHG)Olympus Zuiko
      14-35mm f/2.0 Digital ED SWD.  There is no doubt the SHG offering is the
      best Olympus has to offer in this group, but its price tag is often
      prohibitive to amateurs and even serious amateurs.  For most consumers who
      desire the image quality without breaking the bank, the choice is between
      Zuiko 14-54mm f/2.8-3.5 MK II and Zuiko 12-60mm f/2.8-4 SWD.  For most
      people I highly recommend Zuiko 14-54mm f/2.8-3.5 MK II and Zuiko 50-200mm
      f/2.8-3.5 SWD combo for the best bang for the money, and they both use
      67mm filter thread so you can share filters together.  This is a major
      cost saving as a high quality Circular Polarizer filter that won't
      deteriorate your HG Olympus lens can cost you and average between
      $80-120.  Let me give you a little of my credential.  I have used all the
      mentioned lenses from Olympus listed above, except for the SG 14-42mm, so
      I am offering my advice as a real world user, rather than a specs
      researcher.  I have used my Olympus E-620 DSLR for two years now, so my
      experience with Olympus 4/3 camera is very extensive.  I would describe
      myself as a serious amateur, who fine tune his LCD monitor in order to get
      the best enlargement prints possible.  The objective of this review is to
      provide some insight whether you should invest in Zuiko 12-60mm f/2.8-4
      SWD over Zuiko 14-54mm f/2.8-3.5 MK II, which costs almost $300 more. 
      Sharpness:  Zuiko 12-60mm wins here.  The major difference would be corner
      performance.  Under good lighting, both would perform admirably.  In poor
      light, Zuiko 12-60mm wins.  As with most 4/3 lenses, both lenses are sharp
      wide-open.  There is no need to stop down two stops to get to the first
      "usable" aperture, unlike competitors' lenses.  However, when you do stop
      down by two stops, that's where 4/3 sensor's optimal range range (f/4-8),
      and you will get exceptionally sharp photos.  Geometric Distortion:  Zuiko
      12-60mm wins hand down.  Many reports shows at 12mm, Zuiko 12-60mm has a
      weird "mustache shape" distortion, which is true.  However, unless you
      shoot for absolute straight line, and stand at a very close distance to
      your subject, this is largely ignorable.  For architecture photos where
      straight lines are crucial, I recommend using software provided by Olympus
      (Olympus Viewer or Olympus Master) to process your RAW images, as there is
      a very easy option to automatically correct geometric distortion using
      built-in lens data (click on RAW button on Olympus Viewer tool bar, then
      select Gear tab -> Distortion Correction -> Auto -> Apply).  Geometric
      distortion is not a problem for both lenses after 18mm (around 36mm in FF
      term).  Vignette: Zuiko 12-60mm also wins here.  Vignette is visible at
      14mm for Zuiko 14-54mm MK II.  Zuiko 12-60mm for most part, does not have
      noticeable vignette, but they do exist upon close inspection.  Be sure to
      use filter with thinner mount, as that can decrease the chance of
      vignetting.  If vignette performance is absolutely crucial for you, I
      recommend SHG 14-35mm SWD, if you're willing to pay for its premium price
      tag (though it is still a bargain compared with the competitors' offerings
      at same performance level).  Chromatic Aberration:  "The purple fringe" is
      usually a problem with wide angle lenses.  Zuiko 12-60mm SWD performs
      admirably here even at 12mm.  I rarely see any CA in my photos, and when
      they do exist, the line is very clean.  Same for Zuiko 14-54mm MK II. 
      Since both lenses' CA are very clean and not bleeding type, the purple
      fringe can be easily removed with software such asAdobe Photoshop
      Lightroom 3(Select Lens Correction -> Defringe) without using very
      complicated procedure.  Color/Contrast:  Again, Zuiko 12-60mm SWD wins
      here.  For best contrast, color and saturation, I recommend using Olympus
      Viewer (or Olympus Master) for developing your own RAW photos to retain
      the eye-pleasing Olympus color.  Color/contrast level is highly subjective
      to each person's taste, so please judge it accordingly to your own
      preference.  Exposure and lighting condition will also affect color
      saturation and contrast quite a bit, so keep that in mind.  4/3 sensor is
      smaller than full frame sensor, so it prefers a little brighter lighting
      than usual and ALWAYS use a lens hood, even when you're indoor, for best
      color/contrast out of your photos (lens hood is used to cut down stray
      light, which will affect color and contrast, as well as sharpness, most
      apparent when you use smaller apertures such as f/11-f/22).  Bokeh
      Quality:  For people who like to shoot close up photos with shallow Depth
      of Field (DoF), bokeh (out of focus area) quality is just as important as
      in-focus area.  Generally speaking, you want to have smooth bokeh pattern
      so it does NOT take attention away from focus area.  Bokeh quality for
      both lenses being compared, are exceptional in their understated manner. 
      The circular 7-blade aperture diaphragm design will give you those perfect
      round light spheres in the background, instead of geometric or even...,
      the highly undesirable cat-eye shape light spheres that are usually found
      in with large aperture lenses (bokeh quality is often sacrificed in large
      aperture lenses because they're more difficult to design).  Both lenses
      are exceptionally good bokeh performers.  Size:  This is where Zuiko
      14-54mm MK II wins.  According to official data, Zuiko 12-60mm SWD is 135g
      (4.8 oz) heavier.  While it is only 0.4" (10mm) longer, 12-60mm SWD lens
      barrel extends much longer when you zoom in.  Keep in mind 12-60mm also is
      thicker and uses a 72mm filter rather than 67mm filter.  If portability is
      your greatest concern, I recommend using Zuiko 14-54mm MK II, as not only
      it's lighter and smaller, you also only need to carry one set of filters
      if you also carry Zuiko 50-200mm SWD, as both lenses share the same 67mm
      filter thread.  Both have very reassuring heft in hand, though I believe
      14-54mm MK II matches better with smaller cameras while Zuiko 12-60mm SWD
      matches better with E-30 and E-5 DSLRs.  I use my Zuiko 12-60mm SWD with
      E-620, while it is a little heavier, but it is still doable.  You should
      always hold your camera by the barrel, rather than holding it by the grip
      (use grip as support, rather than holding the entire camera with it). 
      Build Quality:  Olympus 4/3 lenses HG and up are built like tanks, no
      exception here.  As with all other HG and up lenses, they're both weather
      sealed and both have focus meters on the barrels.  Both lenses' mounts are
      made of metal (not cheap plastic), and so is the barrel construction.  The
      outer shells of the lenses are covered with fibre glass reinforced
      plastic, the same material used in Olympus DSLRs for high quality feel as
      well as consistency of cosmetics.  There is no <PERSON> feel with your
      Olympus 4/3 set up, no matter which lens you choose.  Both lenses (as well
      as Zuiko 14-35mm SWD) are made in Japan.  I have never had an Olympus
      product failed on me in the two years I have used my DSLR and lenses. 
      Overall Image Quality (IQ):  This is subjective.  If you are a casual
      shooter who values IQ, then I would say start with Zuiko 14-54mm MK II and
      see if it would satisfy your needs.  If you mostly post photos on Flickr,
      down sample your photos to 3MP, I also recommend using Zuiko 14-54mm MK
      II, as the incremental IQ will not be noticed.  If you are a pixel peeper
      who scrutinizes every detail of the photos, and can tell the IQ
      deterioration caused by using a cheap filter, then Zuiko 12-60mm SWD is
      your lens (and possibly you may even consider the SHG Zuiko 14-35mm SWD). 
      AF Speed:  If you use LiveView (LCD screen) for composition most of the
      time, which uses CDAF (contrast detect auto focus), the cheaper Zuiko
      14-54mm MK II actually can AF faster.  While SWD (Sonic Wave Drive) is an
      AF technology, similar to Canon's Ultrasonic Wave drive, what it also
      brings is mechanical coupled manual focus helicord.  What this means when
      you want full time manual focus over ride (you can manual focus even when
      you're on AF mode, and can do pre-focus using focus meter on lens barrel,
      without turn on the camera first, useful if you're a professional who
      prefer Zone Focusing for fast moving subjects), you want to use a SWD
      lens, such as Zuiko 12-60mm SWD.  SWD enabled focus ring is stiffer to
      turn due to their mechanical nature, which provides some feedback to your
      focus experience.  The focus ring does NOT stop at each end of focus
      range, but you will feel them as they become tighter to turn.  For fastest
      focus experience, I recommend you read your Olympus DSLR's manual and see
      how you can switch the AFL button for focus lock (rather than half-press
      the shutter button for the job), and pre-select AF point (the dots button)
      before you focus.  This will increase your AF speed significantly by
      closing down the range the camera needs to focus on.  12-60mm SWD's AF is
      generally very fast and most importantly, accurate.  Value:  Let's put it
      this way.  Zuiko 14-54mm MK II is for people who want to spend least
      amount of money and get the best IQ, whereas Zuiko 12-60mm SWD is for
      people who want the best IQ without spending too much.  The value depends
      on your priority: budget over IQ or IQ over budget.  I hope this review is
      helpful to you.  :-)
  - text: >-
      Greetings, this is my review for "Vivaldi: The Four Seasons" by Gil Shaham
      and Orpheus. When I first got this CD, I listened to it on an Emerson
      stereo product. It sounded just fine...brilliant and lively, like Vivaldi
      should sound. Then I looked it up on Amazon to read the reviews...and
      about died laughing. Oh, boy. Sniffing?...you gotta be kidding. Okay, so I
      listened to it again, and still didn't notice any sniffing. So then I put
      it in the disc drive of my computer, plugged in my headphones, and turned
      it up as loud as I could stand it to be. You would need hearing like the
      Bionic Man to notice that the guy playing the violin is yes, indeedy
      breathing through his nose whilest he's playing. I could only hear it in
      the quietest passages, with the volume turned all the way up. Yes,
      possibly this was due to the microphone being placed a little too close to
      the violinist, but it doesn't ruin the recording. It's still very
      listenable and enjoyable.  While we're on the subject, here's a short list
      of people you can hear breathing on their recordings...Patsy Cline, bless
      her, when she inhales between lyrics of a song, she is absolutely right
      there in the room with you. Rosemary Clooney, in order to faciliate her
      incredible phrasing and singing talent, also was known to take a noticably
      deep breath before a loud note or an especially high one. Wayne Newton, in
      his classic soprano incarnation, often took a sharp whistling breath
      between lines of his songs, this was due to his childhood asthma but it
      sure didn't limit his volume or his pitch. Then there's Donovan Leitch who
      breathes and sighs all over the place...it adds to the atmospheric effect
      of his vocal style.  I'm sure that poor Gil Shaham didn't sniff on
      purpose, but it's probably very hard to breathe with one's mouth open
      while they've got a violin shoved under their chin. Thank you for your
      consideration in this matter, and direct all comments to
      <EMAIL_ADDRESS><PERSON> and <PERSON>. When I first got this CD, I listened
      to it on an Emerson stereo product. It sounded just fine...brilliant and
      lively, like Vivaldi should sound. Then I looked it up on Amazon to read
      the reviews...and about died laughing. Oh, boy. Sniffing?...you gotta be
      kidding. Okay, so I listened to it again, and still didn't notice any
      sniffing. So then I put it in the disc drive of my computer, plugged in my
      headphones, and turned it up as loud as I could stand it to be. You would
      need hearing like the Bionic Man to notice that the guy playing the violin
      is yes, indeedy breathing through his nose whilest he's playing. I could
      only hear it in the quietest passages, with the volume turned all the way
      up. Yes, possibly this was due to the microphone being placed a little too
      close to the violinist, but it doesn't ruin the recording. It's still very
      listenable and enjoyable.  While we're on the subject, here's a short list
      of people you can hear breathing on their recordings...<PERSON>, bless
      her, when she inhales between lyrics of a song, she is absolutely right
      there in the room with you. <PERSON>, in order to faciliate her incredible
      phrasing and singing talent, also was known to take a noticably deep
      breath before a loud note or an especially high one. <PERSON>, in his
      classic soprano incarnation, often took a sharp whistling breath between
      lines of his songs, this was due to his childhood asthma but it sure
      didn't limit his volume or his pitch. Then there's <PERSON> who breathes
      and sighs all over the place...it adds to the atmospheric effect of his
      vocal style.  I'm sure that poor <PERSON> didn't sniff on purpose, but
      it's probably very hard to breathe with one's mouth open while they've got
      a violin shoved under their chin. Thank you for your consideration in this
      matter, and direct all comments to brideofcyrano@aol.com
  - text: >-
      The Rite is a very good movie despite the horrible critic reviews.  Having
      missed it in theaters I rented it on Amzon's video on demand.  Like the
      Exorcism of Emily Rose, this is not a horror film.  If you are looking to
      be scared, this is not the movie for you. Though most horror films are
      more disgusting than scary.  The Rite begins with the character of who
      <PERSON> fed up with working in his father's mortuary. He wants to leave
      but can't pay for college. So he decides to join the seminary so as to get
      a college education for free, even though he personally believes in
      nothing.  When he graduates, <PERSON> attempts to resign, but the priest
      he sends his resignation to is not fooled and indirectly threatens to
      force him to pay back the cost of his education.  He doesn't do this out
      of spite, but because he sees something in <PERSON> that <PERSON> doesn't
      see in himself.  Reluctantly, <PERSON> agrees to go to Rome for two month
      to study exorcism with the notion that if when he gets back and still
      wants to resign, he can without repercussions.  While in Rome, <PERSON>
      challenges the professor of the exorcism course thereby publicly
      announcing his own doubts.  He is later sent to work with an older priest,
      Father <PERSON>, who is an exorcist and has been in the trade for some
      time. <PERSON> immediately shows <PERSON> a possessed pregnant girl as
      proof of the existence of the devil. They continue to work on saving the
      possessed girl, who later dies in the movie. I like the scene where they
      first meet.  Fr. <PERSON> doesn't waste time with chit chat, he just
      immediately gets into the matter. Also, <PERSON> meets a female reporter
      named <PERSON> while in Rome. They connect and become friends. At least
      the script writers decided to not put a romantic interest between them.
      <PERSON> does a good job of playing the professional reporter who connects
      with <PERSON> as she too searches for the truth and has something in
      common with him.  As the movie progresses <PERSON> is forced to face his
      inner demons. The flashbacks in the movie let the viewer know that he lost
      his faith when his mother died, but had obviously hung on to a bit of it
      as he has spent his whole life searching for the truth about God and the
      Devil. <PERSON> does an excellent job playing the doubting <PERSON> as he
      is forced to face actual cases of possession and admit that maybe the
      devil is real. Never once did I think his performance was forced. He was
      able to display the character's inner turmoil and the fact that <PERSON>
      truly cares about these people that <PERSON> takes him to. At one point he
      challenges the older Fr. <PERSON> saying that the pregnant girl needs a
      psychiatrist more than a priest. Even though you can tell that even he is
      wondering if maybe she is possessed as she knows things about his past
      that no one knows about.  <PERSON> does a superb job as Father <PERSON>.
      When you first meet him he is a get down to business type and seems a bit
      off putting.  As the movie continues <PERSON> manages to demonstrate the
      emotional side of the character without it seeming cheesy or forced. There
      is a scene in which Father <PERSON> is clearly distraught over the young
      girl's death. It is a very emotional scene that even you will feel Fr.
      <PERSON>' pain as he breaks down and cries and pleads with <PERSON> to not
      let the devil destroy his soul like he destroyed the girl's. <PERSON> also
      does a great job portraying the demonic taking over of the older priest
      until the final exorcism scene at the end. In that scene <PERSON> puts a
      certain amount of class into it. Whereas in the Exorcist and in Emily Rose
      the final exorcism scene immediately starts with screaming and cussing and
      anything shocking that Hollywood can throw in; in The Rite, the final
      showdown with the devil starts off with the possessed Fr. <PERSON>
      displaying a certain amount of calm and class that only <PERSON> can
      provide. He gets in <PERSON> and <PERSON>'s heads instead on yelling
      insults at them.  Then, he slowly progresses into a more antagonistic
      character until he physically assaults <PERSON> and the female reporter. 
      Naturally the movie ends with <PERSON> being purified of his demons, which
      is good because I hate sad endings. <PERSON> takes his vows and maintains
      his newfound belief in God and the reality of the devil/evil. I like the
      parting scene between <PERSON> and Fr. <PERSON>. It's not overly
      sentimental, but there is a chemistry between the characters & actors
      where they have a newfound respect for each other as they have both
      witnessed something few ever see.  Like I said, the movie is not scary. I
      found it to be more of a spiritual journey type film that concerns
      <PERSON> and <PERSON> as they both face their own failings and learn to
      accept that evil does exist and only with God can it be fought. But the
      movie also does not ignore science. Even the character of <PERSON> admits
      that there are a lot of supposed possession cases where the person is
      truly mentally ill. The exorcist is there when science can't explain
      what's wrong with an individual. The movie does leave it up to you the
      viewer to decide if you believe in the devil, or  science. It does provide
      believable resolution for the characters as they accept what's happened
      and move on with their lives.  The quality of the movie was very good.  I
      rented the SD version on video on demand. It loaded quickly and there were
      no problems with playback. Not once did it look pixelated. It actually
      felt like I was watching a DVD.  I may buy this on DVD when the price goes
      down some.  I recommend this movie to anyone that likes a good drama and
      isn't expecting another Exorcist movie.  Understand that there is no pea
      soup, spinning heads, or masturbating 12 year old girls.
pipeline_tag: feature-extraction
library_name: sentence-transformers

Sparse Encoder

This is a Sparse Encoder model trained on the json dataset using the sentence-transformers library. It maps sentences & paragraphs to a 512-dimensional sparse vector space and can be used for semantic search and sparse retrieval.

Model Details

Model Description

  • Model Type: Sparse Encoder
  • Maximum Sequence Length: 512 tokens
  • Output Dimensionality: 512 dimensions
  • Similarity Function: Colbert
  • Training Dataset:
    • json

Model Sources

Full Model Architecture

SparseColbertEncoder(
  (0): MLMTransformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'ModernBertForSparseColbert'})
  (1): SpladePooling({'pooling_strategy': 'mean', 'activation_function': 'log1p_relu', 'word_embedding_dimension': 512})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SparseEncoder

# Download from the 🤗 Hub
model = SparseEncoder("sparse_encoder_model_id")
# Run inference
sentences = [
    "Ok, so if you want to step up your coffee game, you need to cut it out with the pre-ground beans and buy whole. And while you're at it, you might as well go with this burr grinder over a blade grinder. It's really not all that much more expensive.  So why a burr grinder? Better consistency. A blade grinder chops up the beans, but by nature can't really produce a consistent size for the grounds. And this will really mess with your coffee extraction. Maybe you're average coffee drinker wouldn't notice it, but then again, they're probably still buying pre-ground coffee. And you're not average, or you wouldn't be looking at this product,right?  Let's get one thing out of the way... this is by no stretch of the imagination a top end grinder. For that, you want to go with a conical, low speed grinder. And that's going to cost. A lot.  This grinder uses two flat serrated discs, a fixed distance apart, depending on how fine or course you want your grounds. Like I said, conical burrs are the preferred, but really disc grinders also do a fine job of crushing the beans. Basically, since the cones or discs are a fixed distance apart, the beans are crushed between them. The beans can't pass through to the collection bin until they are crushed to the size determined by the space between the cones/plates, and it's almost physically impossible for the beans to be crushed smaller (unlike a blade grinder, which can slice some beans to powder, and leave large chunks of others). I mean, that's just in case you were wondering how it all works.  Really where this unit suffers compared to the really high end models is the speed. This is a fast grinder. There's a potential that the speed can create enough friction to heat up the beans a little. Really, though, that's a small concern. The bigger issue is that the speed tends to create static, which causes a lot of mess from grounds clinging all over the machine.  You'll need to clean this thing. Often.  But, aside from that, this thing will give you a better brew. The ability to ground your beans as you need them will give you fresher coffee, and the consistent size of the grind will give you better extraction. And that's what counts, right?  Full disclosure: I'm on my second unit. The first one apparently had a defect in the screw that held on one of the discs. It failed and the unit was non-functional. I hopped on Cuisinart's web site, found this model, and submitted a repair request. They immediately shipped out a new unit, as well as a shipping label to return the defective one. So despite the inconvenience of a bad unit, I have to say that the customer service was flawless.",
    'UPDATE:  I\'m going to have to ding this a couple of stars due to the faulty electronics.  I put in the batteries (it takes 2) shortly before attending a Halloween party and at first all seemed well.  The "eyes" have two on modes:  Flashing and solid.  Both were working as expected (although I\'m not certain why anyone would opt for the flashing mode).  Because it\'s difficult to see when the lights are on, I never intended to leave them on the entire time.  So I switched them on when entering the party, then turned them off to socialize, only turning them on again if someone wanted a photo.  About half way into the party, the lights inexplicably came on into flashing mode.  I pressed the button and switched them to solid, and then pressed it again to switch them off.  About 2 minutes later, they came back on in flashing mode.  This time they wouldn\'t shut off.  I had to take out the batteries.  I had a spare set and tried putting those in, just in case my batteries were faulty.  Things seemed normal for about 15 minutes when the lights again came on into flashing mode.  Again it wouldn\'t switch off, and this time the batter compartment was slightly warm.  Taking this SECOND set of batteries out, I notice some dark heat discoloration.  It kind of makes me wonder what kind of a health hazard this thing might have been had I not caught that the switch circuit board was stressing the batteries.  Bottom line?  This product looks ok (and can look phenomenal with a bit of work), but don\'t trust the electronics in it.  They are dangerous.  ------------------------------  I\'ve read a couple of complaints about this product, so I wanted to address them:  1. Size.  Some reviews have said this runs small.  Taking note, I ordered the larger size, and I\'m glad that I did.  I think that had I gone with the smaller size (which is listed as more in the range of my hat size), I\'d have been very disappointed with the fit.  2. Distortion:  Many have complained about the packaging squishing the helmet.  It would seem that the manufacturer has been paying attention.  Mine arrived in box and had filler inside the helmet to try to retain the shape as much as possible.  There is *some* inevitable distortion from the box, but pretty minimal and easily corrected.  Overall, I have to say that I\'m pretty impressed with this product.  The plastic is flexible, but much sturdier than what I was expecting.  I do have to say, however, that my review and star rating is based on MANAGED expectations.  This is not a completely screen accurate product and it is not without its flaws.  But for what it is, and for the cost, I\'d say it\'s a reasonable costume piece either as is, or (as I intend) a base for further modification. Whether you intend to modify the helmet or not, one suggestion I have for everyone is to obtain some foam padding.  There are some pressure point areas that will likely become uncomfortable with extended wear.',
    'Okay, I like the Panasonic\'s Zs cameras. They\'re easy to get the hang of and I\'ve had no reliability issues. I started with a Panasonic Zs3. Later on I upgraded to a Zs7, then when I saw Amazon was selling a Zs9 which was the same as the Zs8 but with a stereo microphone and the price wasn\'t much over $100 (from Amazon Warehouse), I couldn\'t resist buying it for its 16x zoom. It\'s been a great camera. I love my Zs9 with it\'s long zoom despite it not having GPS (which I didn\'t care about) or HDMI out, and with a lower LCD screen resolution than the Zs7. I thought the screen clarity was fine and didn\'t miss the 460,000 dots on the Zs7.  Well, I couldn\'t resist this newer upgraded Zs. The Zs20 is my 4th Panasonic Lumix Zs camera (all of them purchased from Amazon), and I can say without reservation that this is the best of them all. I love the fast burst shooting made possible by the CMOS sensor.  The 16x zoom on the Zs8/9 is really great. I\'ve taken some fantastic close-up shots with it. Now I have a 20x zoom. Amazing. It\'s operates when shooting video too.  Canon\'s G series, by comparison, has a larger 1:1.7 sensor compared to the Zs20 1:2.33. But, the zoom is very limited on the Canon and the camera is too big to carry around in your pocket - and it cost twice as much (and the older unavailable G9 model is better than the later ones I hear.) Their competitor for this Panasonic is their 20x zoom model SX260SH with a similar 1:2.33 CMOS sensor. Professional reviewers are rating the Zs20 higher than the comparable Canon, which is slightly larger, heavier, and costs more. Everyone raves about Panasonic\'s Leica lenses, with good reason. The Zs20 is just an amazing camera for the price. It\'s even slightly smaller than the Zs 7,8/9/10 and easy to carry in your pocket in a thin stretch case. Like the Zs7 (which never cost less than about $250.00) it has the 460,000 dot bright LCD screen, HDMI out, and GPS. It also has more features than the Zs7 or 8/9/10.  Don\'t expect the price to get much lower. As I recall, the Zs10 (the real predecessor of the Zs20) price came down to about the Zs20 price today, or maybe at the very end, a few dollars less, but I wouldn\'t wait. Panasonic may refuse to lower the price any further. It\'s already so heavily discounted, and there is a limit to how low they\'ll go. If you want the absolute best deal, get a "used" one from Amazon Warehouse. It\'s hardly, if at all "used," and most likely brand new but returned for some reason and re-packaged. You have 30 days to send it back if there is anything wrong with it. You don\'t get the one year warranty however, so if that\'s important to you, but a new one. It\'s definitely worth the price. I already had an extra battery but you can buy a non-proprietary battery very inexpensively that lasts even longer than the battery that comes with the camera. I also had a wall charger (two - from my Zs7 and Zs9)), so I didn\'t have to buy that. I\'d say that\'s the only thing Panasonic let down on. It\'s worth getting a wall charger, but it should come with the camera. This is the first time it doesn\'t. Don\'t let it deter you.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 512]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[670.3749, 606.2985, 607.1583],
#         [638.0493, 713.5065, 637.7278],
#         [586.5296, 586.5399, 649.0458]])

Training Details

Training Dataset

json

  • Dataset: json
  • Size: 202,427 training samples
  • Columns: anchor and positive
  • Approximate statistics based on the first 1000 samples:
    anchor positive
    type string string
    details
    • min: 402 tokens
    • mean: 499.1 tokens
    • max: 512 tokens
    • min: 393 tokens
    • mean: 499.22 tokens
    • max: 512 tokens
  • Samples:
    anchor positive
    This knife, and theJ.A. Henckels Twin Four Star 3-Inch High Carbon Stainless-Steel Paring Knifeare the two best knives in the Henckels four star collection. There is something "just so" about them. They are just right, with all the various design parameters coming together to create a whole that is greater than the sum of the parts. This serrated utility knife works well in a great variety of applications. The five inch serrated blade is nicely thin (but still thick enough for good strength and rigidity) and shallow (i.e. not broad). I find it very useful for cutting pie or cake or brownies, as well as (of course) bread and tomatoes and many other vegetables. I've had this knife now for SIXTEEN YEARS, and it is still going strong, and still one of my favorites. However . . . you must SHARPEN this knife eventually. Like any other knife, it will go dull. NEVER HONE THIS KNIFE OR ANY OTHER SERRATED KNIFE! A sharpening steel is too large a diameter to be used on a serrated knife.... When I moved into my first (and current) house from my apartment, the previous owner had a Whirlpool (Ecodyne) WHER25 reverse osmosis system installed under the kitchen sink. I liked the water the system produced, but the flow control was misfunctioning, causing an annoying dripping sound that was almost constant. The installer (previous owner, not a plumber) had NOT made the common mistake of trimming out the flow control--which was the first thing I suspected. No, the problem, rather, was deformation of the thin rubber membranes (there are two) inside the head of the unit. I flipped them over (they are reversible) and this fixed the problem for a month or so, but it returned. I priced out new membranes/gaskets and flow control insert, with shipping, and decided that I should just start fresh with a whole new unit, since it was on a special sale locally and it would come with all new filters ($80 worth). I replaced just the head and all was well for a while. Then the tank stopp...
    The Good: Sawstop customer service is the best I have dealt with in years. When set up correctly it cuts sheet good like a dream. Only a panel saw would seem better. The adjustable stops are stout and easy to use. Great for repeat cuts. Sliding mechanism is very smooth The Bad: No postive stops - in my experience this borders on being a huge problem for two reasons. First, it is not easy to get the fence square to the blade if you want to be very accurate. On the best of days it takes me 5 minutes to get it close enough to make a 48" cut square. Without positive stops I have to square the sliding table fence every time it is bumped or removed. And, I remove it regularly as the sliding table fence sits close enough to the blade that almost all cuts over 48" using the regular saw fence demand the sliding table fence be removed or swung out of the way (if the cut is less than 48" the sliding table can be moved back with fence in place forming a little pocket to work within). The fence th... The Bad (yes there are a lot of bad things even with 5 stars): One of the worst written non fiction books I have ever owned. I really don't care if one of the authors clients liked a sauce so well that she would eat it over kitty litter. I don't care to read 100s of testaments to how good the recipes are (they are pretty good). I just want to get on with the book. Prove the recipes are not good. Don't spend all those pages trying to convince me. It even backfired. I was sure they were going to be terrible are reading all the testaments. Get ready to cook. A lot. Get ready to do a lot of dishes. Have to plan ahead. Have to make lunches the night before often. The flax seed breakfast takes some work and time. Can't just whip it up. If you run out without having already prepared more you will find yourself without a breakfast. Terribly organized. It is not sequential. You will read something and then find out later you were not suppose to do it when you did unless you read the entire b...
    I've had a Samsung WB850 and I still have a Fuji F900EXR. Both are megazoom pocket cameras. I'm sold on pocket megazooms for reasons that I explained in my review of the WB850. I've put my big DSLRs away only for stuff where I need the features of a big DSLR and those times are becoming rarer. I changed from the WB850 for one reason. It is SLOW between shots. Super camera but it just took too much time between shots AND I wanted a camera that would shoot in raw format. The Fuji is fast between shots and it shoots in raw BUT it won't let you run the camera and charge the battery in the camera through the USB port. Therefore I always had to carry extra batteries. After owning the Fuji for a few months, I found that I really did not need raw pictures. I just never used the raw file, only the jpg file. If you don't know what the raw format is, then you most likely don't need raw. I saw the 9700 in a store and was super impressed with the zoom. There is a BIG difference between the 21X me... The system works great! There are a few points that I would like to point out for installation. 1. Each controller will handle up to three doors or gates but you can add multiple controllers. I have 5 garage doors to control. I needed two controllers and three extra door sensors since each controller comes with one sensor. You must switch between controllers in the app to control each group of doors. The app does remember the last used controller. 2. The app will always default to Door #1 and you must swipe left or right to control Door #2 or #3. Therefore if there is one particular door that you use most, make that door #1. Each door can be labeled with a unique name and the name is what you will see in the app. I use the middle door mainly and I had to go back and rewire the middle door to the #1 terminal so that it would always show up as the default door and I did not need to swipe to select it. Name your controller the PERMANENT name that you want to call it initially. Once it...
  • Loss: model.SpladeMixedTopKLoss.SpladeColbertTopKLoss with these parameters:
    {
        "loss": "ColbertMultipleNegativesRankingLoss",
        "document_regularizer_weight": 0
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • eval_strategy: steps
  • per_device_train_batch_size: 32
  • weight_decay: 0.01
  • num_train_epochs: 2
  • lr_scheduler_type: cosine
  • warmup_ratio: 0.15
  • save_only_model: True
  • fp16: True
  • dataloader_num_workers: 8
  • gradient_checkpointing: True

All Hyperparameters

Click to expand
  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: steps
  • prediction_loss_only: True
  • per_device_train_batch_size: 32
  • per_device_eval_batch_size: 8
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • torch_empty_cache_steps: None
  • learning_rate: 5e-05
  • weight_decay: 0.01
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1
  • num_train_epochs: 2
  • max_steps: -1
  • lr_scheduler_type: cosine
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.15
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: True
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • bf16: False
  • fp16: True
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 8
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • parallelism_config: None
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch_fused
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • project: huggingface
  • trackio_space_id: trackio
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: None
  • hub_always_push: False
  • hub_revision: None
  • gradient_checkpointing: True
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • include_for_metrics: []
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: no
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • use_liger_kernel: False
  • liger_kernel_config: None
  • eval_use_gather_object: False
  • average_tokens_across_devices: True
  • prompts: None
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: proportional
  • router_mapping: {}
  • learning_rate_mapping: {}

Training Logs

Click to expand
Epoch Step Training Loss
0.0032 20 51.0224
0.0063 40 46.0819
0.0095 60 46.7506
0.0126 80 40.6976
0.0158 100 35.4491
0.0190 120 34.5721
0.0221 140 28.963
0.0253 160 19.6304
0.0285 180 10.9879
0.0316 200 9.5982
0.0348 220 9.2003
0.0379 240 6.7052
0.0411 260 4.6554
0.0443 280 4.086
0.0474 300 4.087
0.0506 320 3.3029
0.0537 340 2.1971
0.0569 360 2.0595
0.0601 380 1.8372
0.0632 400 1.9924
0.0664 420 1.7445
0.0696 440 1.8178
0.0727 460 1.8642
0.0759 480 1.8262
0.0790 500 1.8874
0.0822 520 1.7832
0.0854 540 1.8586
0.0885 560 1.6379
0.0917 580 1.6858
0.0948 600 1.725
0.0980 620 1.4646
0.1012 640 1.6582
0.1043 660 1.6422
0.1075 680 1.7781
0.1107 700 1.6323
0.1138 720 1.4226
0.1170 740 1.6825
0.1201 760 1.4768
0.1233 780 1.4108
0.1265 800 1.5973
0.1296 820 2.1262
0.1328 840 1.6433
0.1359 860 1.4942
0.1391 880 1.428
0.1423 900 1.4673
0.1454 920 1.6073
0.1486 940 1.5121
0.1518 960 1.4637
0.1549 980 1.4504
0.1581 1000 1.3666
0.1612 1020 1.2478
0.1644 1040 1.4773
0.1676 1060 1.3332
0.1707 1080 1.5554
0.1739 1100 1.4678
0.1770 1120 1.5669
0.1802 1140 1.5097
0.1834 1160 1.522
0.1865 1180 1.4468
0.1897 1200 1.9428
0.1929 1220 1.465
0.1960 1240 1.2246
0.1992 1260 1.2841
0.2023 1280 1.9893
0.2055 1300 1.8857
0.2087 1320 1.9589
0.2118 1340 2.6501
0.2150 1360 1.7995
0.2181 1380 1.6703
0.2213 1400 1.7977
0.2245 1420 9.0095
0.2276 1440 4.4864
0.2308 1460 1.8035
0.2340 1480 1.8827
0.2371 1500 1.6785
0.2403 1520 1.6785
0.2434 1540 1.4908
0.2466 1560 1.7944
0.2498 1580 1.4897
0.2529 1600 1.4564
0.2561 1620 1.6748
0.2592 1640 2.0216
0.2624 1660 1.8719
0.2656 1680 1.6885
0.2687 1700 1.6456
0.2719 1720 2.705
0.2751 1740 1.5988
0.2782 1760 2.2147
0.2814 1780 1.6379
0.2845 1800 4.3891
0.2877 1820 2.0351
0.2909 1840 5.2546
0.2940 1860 1.9242
0.2972 1880 1.7494
0.3003 1900 1.6151
0.3035 1920 1.4176
0.3067 1940 1.437
0.3098 1960 1.4542
0.3130 1980 1.3772
0.3162 2000 1.2476
0.3193 2020 1.2809
0.3225 2040 1.4377
0.3256 2060 1.3807
0.3288 2080 1.6717
0.3320 2100 1.9828
0.3351 2120 1.6067
0.3383 2140 1.5362
0.3414 2160 1.7725
0.3446 2180 2.0667
0.3478 2200 2.0853
0.3509 2220 1.9987
0.3541 2240 2.992
0.3573 2260 1.8463
0.3604 2280 3.1545
0.3636 2300 15.7637
0.3667 2320 1.9978
0.3699 2340 1.945
0.3731 2360 1.5158
0.3762 2380 1.5513
0.3794 2400 1.6189
0.3825 2420 1.207
0.3857 2440 1.3031
0.3889 2460 1.4802
0.3920 2480 1.3991
0.3952 2500 1.8346
0.3984 2520 1.5484
0.4015 2540 2.2428
0.4047 2560 2.14
0.4078 2580 2.0932
0.4110 2600 2.209
0.4142 2620 1.4263
0.4173 2640 2.3412
0.4205 2660 1.4003
0.4236 2680 1.5189
0.4268 2700 1.4755
0.4300 2720 1.3064
0.4331 2740 1.4582
0.4363 2760 1.2775
0.4395 2780 1.3225
0.4426 2800 1.5367
0.4458 2820 1.2568
0.4489 2840 1.7647
0.4521 2860 1.7597
0.4553 2880 4.7062
0.4584 2900 1.8907
0.4616 2920 1.7383
0.4647 2940 1.7114
0.4679 2960 3.4897
0.4711 2980 2.5594
0.4742 3000 1.5845
0.4774 3020 1.8826
0.4806 3040 1.3545
0.4837 3060 1.1237
0.4869 3080 1.2711
0.4900 3100 1.3153
0.4932 3120 1.1831
0.4964 3140 1.0836
0.4995 3160 1.1604
0.5027 3180 1.1936
0.5058 3200 1.1445
0.5090 3220 1.1684
0.5122 3240 1.4851
0.5153 3260 1.0159
0.5185 3280 1.0514
0.5217 3300 1.5337
0.5248 3320 1.1051
0.5280 3340 0.993
0.5311 3360 1.0731
0.5343 3380 1.1315
0.5375 3400 1.2055
0.5406 3420 1.2663
0.5438 3440 1.1961
0.5469 3460 1.1168
0.5501 3480 1.1537
0.5533 3500 1.0855
0.5564 3520 1.0889
0.5596 3540 1.2653
0.5628 3560 1.1322
0.5659 3580 1.1083
0.5691 3600 1.2111
0.5722 3620 1.0297
0.5754 3640 1.0228
0.5786 3660 1.1103
0.5817 3680 1.0392
0.5849 3700 2.0697
0.5880 3720 1.1245
0.5912 3740 1.3946
0.5944 3760 1.2791
0.5975 3780 1.3011
0.6007 3800 2.201
0.6039 3820 1.7853
0.6070 3840 2.4911
0.6102 3860 1.4009
0.6133 3880 1.5732
0.6165 3900 1.6166
0.6197 3920 1.3355
0.6228 3940 1.3077
0.6260 3960 1.3978
0.6291 3980 1.217
0.6323 4000 1.1321
0.6355 4020 1.2489
0.6386 4040 1.4003
0.6418 4060 1.2856
0.6450 4080 1.2755
0.6481 4100 1.359
0.6513 4120 1.2831
0.6544 4140 2.1854
0.6576 4160 1.4309
0.6608 4180 1.2369
0.6639 4200 1.8062
0.6671 4220 1.1089
0.6702 4240 1.298
0.6734 4260 1.856
0.6766 4280 1.0942
0.6797 4300 1.2997
0.6829 4320 1.2618
0.6861 4340 1.2454
0.6892 4360 1.2287
0.6924 4380 1.0574
0.6955 4400 1.2485
0.6987 4420 1.1999
0.7019 4440 1.365
0.7050 4460 1.1399
0.7082 4480 1.1749
0.7113 4500 0.9975
0.7145 4520 1.091
0.7177 4540 1.1958
0.7208 4560 1.2429
0.7240 4580 1.0754
0.7272 4600 1.1375
0.7303 4620 0.9687
0.7335 4640 1.1116
0.7366 4660 1.1247
0.7398 4680 1.0041
0.7430 4700 1.1475
0.7461 4720 1.009
0.7493 4740 1.0766
0.7525 4760 1.0439
0.7556 4780 1.0375
0.7588 4800 1.1947
0.7619 4820 1.1056
0.7651 4840 1.1536
0.7683 4860 1.1331
0.7714 4880 1.2056
0.7746 4900 1.1386
0.7777 4920 1.1071
0.7809 4940 1.1398
0.7841 4960 1.0538
0.7872 4980 1.1586
0.7904 5000 1.1045
0.7936 5020 1.3062
0.7967 5040 1.0418
0.7999 5060 1.0489
0.8030 5080 1.1749
0.8062 5100 1.1846
0.8094 5120 1.0213
0.8125 5140 1.0913
0.8157 5160 1.0274
0.8188 5180 1.1513
0.8220 5200 1.1334
0.8252 5220 0.983
0.8283 5240 1.1193
0.8315 5260 1.1365
0.8347 5280 1.0199
0.8378 5300 1.0998
0.8410 5320 1.0869
0.8441 5340 1.0876
0.8473 5360 0.98
0.8505 5380 0.9861
0.8536 5400 0.9734
0.8568 5420 1.0592
0.8599 5440 0.9645
0.8631 5460 1.0039
0.8663 5480 1.0924
0.8694 5500 0.992
0.8726 5520 0.9431
0.8758 5540 0.9863
0.8789 5560 1.1285
0.8821 5580 1.1716
0.8852 5600 1.3165
0.8884 5620 0.9794
0.8916 5640 0.9701
0.8947 5660 1.0022
0.8979 5680 0.9852
0.9010 5700 1.0187
0.9042 5720 1.1792
0.9074 5740 1.0148
0.9105 5760 1.0235
0.9137 5780 1.1205
0.9169 5800 1.0007
0.9200 5820 1.0862
0.9232 5840 1.1729
0.9263 5860 1.0947
0.9295 5880 1.2138
0.9327 5900 1.1355
0.9358 5920 1.0611
0.9390 5940 1.0897
0.9421 5960 1.1935
0.9453 5980 1.0426
0.9485 6000 1.0054
0.9516 6020 0.9846
0.9548 6040 1.1063
0.9580 6060 1.1182
0.9611 6080 1.1038
0.9643 6100 0.9971
0.9674 6120 1.0664
0.9706 6140 0.9269
0.9738 6160 0.9931
0.9769 6180 1.1571
0.9801 6200 0.9641
0.9832 6220 1.0037
0.9864 6240 0.9284
0.9896 6260 0.9384
0.9927 6280 0.9436
0.9959 6300 1.1286
0.9991 6320 0.99
1.0022 6340 0.9625
1.0054 6360 0.9904
1.0085 6380 1.1067
1.0117 6400 0.9747
1.0149 6420 1.0062
1.0180 6440 1.0048
1.0212 6460 1.0333
1.0243 6480 0.9388
1.0275 6500 1.0325
1.0307 6520 1.2297
1.0338 6540 0.8533
1.0370 6560 1.2967
1.0402 6580 0.8525
1.0433 6600 0.8978
1.0465 6620 0.8544
1.0496 6640 0.9956
1.0528 6660 0.891
1.0560 6680 0.9151
1.0591 6700 0.9331
1.0623 6720 0.9102
1.0654 6740 1.0807
1.0686 6760 0.9404
1.0718 6780 1.0642
1.0749 6800 0.9148
1.0781 6820 1.59
1.0813 6840 0.9959
1.0844 6860 0.899
1.0876 6880 0.7978
1.0907 6900 0.89
1.0939 6920 0.8647
1.0971 6940 0.8467
1.1002 6960 0.885
1.1034 6980 0.88
1.1065 7000 1.0521
1.1097 7020 0.8291
1.1129 7040 0.8833
1.1160 7060 0.848
1.1192 7080 1.117
1.1224 7100 0.8781
1.1255 7120 0.8427
1.1287 7140 0.9338
1.1318 7160 0.92
1.1350 7180 0.8026
1.1382 7200 1.0017
1.1413 7220 0.7907
1.1445 7240 0.9046
1.1476 7260 0.8531
1.1508 7280 0.8682
1.1540 7300 0.8476
1.1571 7320 0.9424
1.1603 7340 1.1001
1.1635 7360 0.8698
1.1666 7380 0.8657
1.1698 7400 1.1927
1.1729 7420 0.8589
1.1761 7440 0.9243
1.1793 7460 0.8303
1.1824 7480 0.8336
1.1856 7500 0.9096
1.1887 7520 0.8451
1.1919 7540 0.9047
1.1951 7560 0.8424
1.1982 7580 1.0648
1.2014 7600 0.8298
1.2046 7620 0.8947
1.2077 7640 0.9452
1.2109 7660 0.8179
1.2140 7680 0.8432
1.2172 7700 0.9081
1.2204 7720 0.8813
1.2235 7740 0.931
1.2267 7760 1.0365
1.2298 7780 0.8473
1.2330 7800 0.9272
1.2362 7820 0.9343
1.2393 7840 0.9044
1.2425 7860 1.0213
1.2457 7880 1.0027
1.2488 7900 0.7587
1.2520 7920 0.8479
1.2551 7940 0.9856
1.2583 7960 0.9362
1.2615 7980 0.7739
1.2646 8000 0.8295
1.2678 8020 0.8763
1.2709 8040 0.8687
1.2741 8060 0.8208
1.2773 8080 0.8885
1.2804 8100 0.7502
1.2836 8120 0.8033
1.2868 8140 0.7889
1.2899 8160 0.877
1.2931 8180 0.8265
1.2962 8200 0.7398
1.2994 8220 0.8153
1.3026 8240 0.8907
1.3057 8260 0.8414
1.3089 8280 0.8596
1.3120 8300 0.8089
1.3152 8320 0.901
1.3184 8340 0.85
1.3215 8360 0.7995
1.3247 8380 0.8041
1.3279 8400 0.8245
1.3310 8420 0.841
1.3342 8440 0.8057
1.3373 8460 0.8006
1.3405 8480 0.8628
1.3437 8500 0.7639
1.3468 8520 0.7358
1.3500 8540 0.8402
1.3531 8560 0.7555
1.3563 8580 0.7543
1.3595 8600 0.9256
1.3626 8620 0.7734
1.3658 8640 0.847
1.3690 8660 0.9097
1.3721 8680 0.8403
1.3753 8700 0.8301
1.3784 8720 0.8291
1.3816 8740 0.7924
1.3848 8760 0.7367
1.3879 8780 0.7882
1.3911 8800 0.7488
1.3942 8820 0.7537
1.3974 8840 0.8685
1.4006 8860 0.8137
1.4037 8880 0.7575
1.4069 8900 0.7976
1.4101 8920 0.8409
1.4132 8940 0.9513
1.4164 8960 0.8705
1.4195 8980 0.7999
1.4227 9000 0.7624
1.4259 9020 0.7974
1.4290 9040 0.8693
1.4322 9060 0.8127
1.4353 9080 0.7921
1.4385 9100 0.7481
1.4417 9120 0.7952
1.4448 9140 0.8285
1.4480 9160 0.8434
1.4512 9180 0.7587
1.4543 9200 0.7393
1.4575 9220 0.7814
1.4606 9240 0.7562
1.4638 9260 0.7386
1.4670 9280 0.8138
1.4701 9300 0.7142
1.4733 9320 0.8692
1.4764 9340 0.8034
1.4796 9360 0.717
1.4828 9380 0.836
1.4859 9400 0.7148
1.4891 9420 0.7679
1.4923 9440 0.8217
1.4954 9460 0.7525
1.4986 9480 0.86
1.5017 9500 0.7942
1.5049 9520 0.8041
1.5081 9540 0.799
1.5112 9560 0.756
1.5144 9580 0.837
1.5175 9600 0.8749
1.5207 9620 0.7633
1.5239 9640 0.7509
1.5270 9660 0.8159
1.5302 9680 0.7781
1.5334 9700 0.7599
1.5365 9720 0.6982
1.5397 9740 0.8073
1.5428 9760 0.6966
1.5460 9780 0.7164
1.5492 9800 0.7268
1.5523 9820 0.7747
1.5555 9840 0.7624
1.5586 9860 0.8413
1.5618 9880 0.8059
1.5650 9900 0.7293
1.5681 9920 0.7917
1.5713 9940 0.7425
1.5745 9960 0.8199
1.5776 9980 0.6358
1.5808 10000 0.8382
1.5839 10020 0.6819
1.5871 10040 0.7629
1.5903 10060 0.7251
1.5934 10080 0.6862
1.5966 10100 0.6728
1.5997 10120 0.7256
1.6029 10140 0.6446
1.6061 10160 0.7801
1.6092 10180 0.7446
1.6124 10200 0.7957
1.6156 10220 0.6786
1.6187 10240 0.777
1.6219 10260 0.7205
1.6250 10280 0.7808
1.6282 10300 0.6608
1.6314 10320 0.787
1.6345 10340 0.8569
1.6377 10360 0.808
1.6408 10380 0.6758
1.6440 10400 0.767
1.6472 10420 0.6474
1.6503 10440 0.6467
1.6535 10460 0.8749
1.6567 10480 0.7917
1.6598 10500 0.7995
1.6630 10520 0.8391
1.6661 10540 0.6797
1.6693 10560 0.7793
1.6725 10580 0.7846
1.6756 10600 0.7955
1.6788 10620 0.7209
1.6819 10640 0.7081
1.6851 10660 0.8094
1.6883 10680 0.6294
1.6914 10700 0.7488
1.6946 10720 0.6678
1.6978 10740 0.8104
1.7009 10760 0.7151
1.7041 10780 0.7325
1.7072 10800 0.7166
1.7104 10820 0.7352
1.7136 10840 0.7217
1.7167 10860 0.6562
1.7199 10880 0.724
1.7230 10900 0.7551
1.7262 10920 0.7943
1.7294 10940 0.6726
1.7325 10960 0.7341
1.7357 10980 0.7833
1.7389 11000 0.8878
1.7420 11020 0.6835
1.7452 11040 0.7896
1.7483 11060 0.7423
1.7515 11080 0.6556
1.7547 11100 0.7358
1.7578 11120 0.7338
1.7610 11140 0.706
1.7641 11160 0.7497
1.7673 11180 0.7765
1.7705 11200 0.6656
1.7736 11220 0.7342
1.7768 11240 0.6819
1.7800 11260 0.7076
1.7831 11280 0.6866
1.7863 11300 0.6698
1.7894 11320 0.7041
1.7926 11340 0.7096
1.7958 11360 0.7455
1.7989 11380 0.7833
1.8021 11400 0.7309
1.8052 11420 0.7
1.8084 11440 0.7249
1.8116 11460 0.74
1.8147 11480 0.7983
1.8179 11500 0.7073
1.8211 11520 0.7368
1.8242 11540 0.7355
1.8274 11560 0.6652
1.8305 11580 0.8112
1.8337 11600 0.7435
1.8369 11620 0.8407
1.8400 11640 0.7431
1.8432 11660 0.6903
1.8463 11680 0.661
1.8495 11700 0.7415
1.8527 11720 0.6872
1.8558 11740 0.7724
1.8590 11760 0.7164
1.8622 11780 0.7654
1.8653 11800 0.7127
1.8685 11820 0.7753
1.8716 11840 0.7416
1.8748 11860 0.678
1.8780 11880 0.6654
1.8811 11900 0.769
1.8843 11920 0.7431
1.8874 11940 0.6651
1.8906 11960 0.6609
1.8938 11980 0.6211
1.8969 12000 0.7582
1.9001 12020 0.6723
1.9033 12040 0.6761
1.9064 12060 0.6528
1.9096 12080 0.7636
1.9127 12100 0.6828
1.9159 12120 0.7284
1.9191 12140 0.7366
1.9222 12160 0.7131
1.9254 12180 0.7336
1.9285 12200 0.6609
1.9317 12220 0.714
1.9349 12240 0.7667
1.9380 12260 0.7339
1.9412 12280 0.6457
1.9444 12300 0.7091
1.9475 12320 0.8099
1.9507 12340 0.7493
1.9538 12360 0.6731
1.9570 12380 0.7489
1.9602 12400 0.699
1.9633 12420 0.7104
1.9665 12440 0.6983
1.9696 12460 0.7652
1.9728 12480 0.8277
1.9760 12500 0.6991
1.9791 12520 0.7358
1.9823 12540 0.7621
1.9855 12560 0.6943
1.9886 12580 0.8008
1.9918 12600 0.8008
1.9949 12620 0.7819
1.9981 12640 0.6837

Framework Versions

  • Python: 3.11.14
  • Sentence Transformers: 5.1.1
  • Transformers: 4.57.1
  • PyTorch: 2.8.0+cu128
  • Accelerate: 1.11.0
  • Datasets: 4.2.0
  • Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

FlopsLoss

@article{paria2020minimizing,
    title={Minimizing flops to learn efficient sparse representations},
    author={Paria, Biswajit and Yeh, Chih-Kuan and Yen, Ian EH and Xu, Ning and Ravikumar, Pradeep and P{'o}czos, Barnab{'a}s},
    journal={arXiv preprint arXiv:2004.05665},
    year={2020}
}