README.md

metadata

tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - dense
  - generated_from_trainer
  - dataset_size:26136
  - loss:CachedMultipleNegativesRankingLoss
base_model: intfloat/e5-small-v2
widget:
  - source_sentence: 'query: Do Artificial Food Dyes Cause ADHD?'
    sentences:
      - >-
        passsage: It has become widely accepted that Type 2 diabetes is
        inevitably life-long, with irreversible and progressive beta cell
        damage. However, the restoration of normal glucose metabolism within
        days after bariatric surgery in the majority of people with Type 2
        diabetes disproves this concept. There is now no doubt that this
        reversal of diabetes depends upon the sudden and profound decrease in
        food intake, and does not relate to any direct surgical effect. The
        Counterpoint study demonstrated that normal glucose levels and normal
        beta cell function could be restored by a very low calorie diet alone.
        Novel magnetic resonance methods were applied to measure intra-organ
        fat. The results showed two different time courses: a) resolution of
        hepatic insulin sensitivity within days along with a rapid fall in liver
        fat and normalisation of fasting glucose levels; and b) return of normal
        beta cell insulin secretion over weeks in step with a fall in pancreas
        fat. Now that it has been possible to observe the pathophysiological
        events during reversal of Type 2 diabetes, the reverse time course of
        events which determine the onset of the condition can be identified. The
        twin cycle hypothesis postulates that chronic calorie excess leads to
        accumulation of liver fat with eventual spill over into the pancreas.
        These self-reinforcing cycles between liver and pancreas eventually
        cause metabolic inhibition of insulin secretion after meals and onset of
        hyperglycaemia. It is now clear that Type 2 diabetes is a reversible
        condition of intra-organ fat excess to which some people are more
        susceptible than others.
      - >-
        passsage: A great deal of effort is now being devoted to the development
        of new drugs that hopefully will control the spread of inoperable cancer
        by safely inhibiting tumor-evoked angiogenesis. However, there is
        growing evidence that certain practical nutritional measures have the
        potential to slow tumor angiogenesis, and it is reasonable to anticipate
        that, by combining several measures that work in distinct but
        complementary ways to impede the angiogenic process, a clinically useful
        'multifocal angiostatic therapy' (MAT) might be devised. Several
        measures which might reasonably be included in such a protocol are
        discussed below, and include: a low-fat, low-glycemic index vegan diet,
        which may down-regulate the systemic IGF-I activity that supports
        angiogenesis; supplemental omega-3-rich fish oil, which has been shown
        to inhibit endothelial expression of Flk-1, a functionally crucial
        receptor for VEGF, and also can suppress tumor production of
        pro-angiogenic eicosanoids; high-dose selenium, which has recently been
        shown to inhibit tumor production of VEGF; green tea polyphenols, which
        can suppress endothelial responsiveness to both VEGF and fibroblast
        growth factor; and high-dose glycine, whose recently reported
        angiostatic activity may reflect inhibition of endothelial cell mitosis,
        possibly mediated by activation of glycine-gated chloride channels. In
        light of evidence that tumor-evoked angiogenesis has a high requirement
        for copper, copper depletion may have exceptional potential as an
        angiostatic measure, and is most efficiently achieved with the
        copper-chelating drug tetrathiomolybdate. If logistical difficulties
        make it difficult to acquire this experimental drug, high-dose zinc
        supplementation can achieve a slower depletion of the body's copper
        pool, and in any case can be used as maintenance therapy to maintain an
        adequate level of copper depletion. A provisional protocol is offered
        for a nutritionally based MAT entailing a vegan diet and supplemental
        intakes of fish oil, selenium, green tea polyphenols, glycine, and zinc.
        Inasmuch as cox-2 is overexpressed in many cancers, and cAMP can boost
        tumor production of various angiogenic factors as well as autogenous
        growth factors, adjunctive use of cox-2-specific NSAIDS may be warranted
        in some cases.
      - >-
        passsage: Attention deficit hyperactivity disorder (ADHD) is one of the
        most common behavioral disorders in children. Symptoms of ADHD include
        hyperactivity, low frustration tolerance, impulsivity, and inattention.
        While the biological pathways leading to ADHD are not clearly
        delineated, a number of genetic and environmental risk factors for the
        disorder are recognized. In the early 1970s, research conducted by Dr.
        Benjamin Feingold found that when hyperactive children were given a diet
        free of artificial food additives and dyes, symptoms of hyperactivity
        were reduced. While some clinical studies supported these findings, more
        rigorous empirical studies conducted over the next 20 years were less
        positive. As a result, research on the role of food additives in
        contributing to ADHD waned. In recent years, however, interest in this
        area has revived. In response to more recent research and public
        petitions, in December 2009 the British government requested that food
        manufacturers remove most artificial food dyes from their products.
        While these strictures could have positive effects on behavior, the
        removal of food dyes is not a panacea for ADHD, which is a multifaceted
        disorder with both biological and environmental underpinnings. © 2011
        International Life Sciences Institute.
  - source_sentence: 'query: Is HDL High in Active Africans?'
    sentences:
      - >-
        passsage: The serum concentration of high-density lipoprotein
        cholesterol and the proportion it constitutes of total serum cholesterol
        are high in children and low in sufferers from coronary heart disease
        (CHD). Studies in elderly black Africans in Western Transvaal showed
        them to be free of CHD. HDL concentrations measured at birth and in
        groups of 10- to 12-year-olds, 16- to 18-year olds, and 60- to
        69-year-olds showed mean values of 0.96, 1.71, 1.58, and 1.94 mmol/l
        (36, 66, 61, and 65 mg/100 ml) respectively; these concentrations
        constitued about 56%, 54%, and 45%, and 47%, of total cholesterol.
        Values thus did not fall from youth to age as they did in whites. Rural
        South African blacks live on a diet high in fibre and low in animal
        protein and fat; children are active; and adults remain active even when
        old. These high values of HDL may well be representative for a
        population that is active, used to a frugal traditional diet, and free
        from CHD.
      - >-
        passsage: Flavonoids have been hypothesized to reduce cancer risk.
        Previous epidemiological studies conducted to evaluate this hypothesis
        have not assessed all flavonoids, including classes that could
        contribute to intake among Americans, which would result in an
        underestimation of intake. This misclassification could mask variability
        among individuals, resulting in attenuated effect estimates for the
        association between flavonoids and cancer. To augment flavonoid and
        lignan intake estimates, we developed a database that can be used in
        conjunction with a food-frequency questionnaire (FFQ). Coupling
        information derived from the available literature with the U.S.
        Department of Agriculture databases, we estimated content of 6 flavonoid
        classes and lignans for 50 food group items. We combined these estimates
        with responses from a modified Block FFQ that was self-completed in
        1996-1997 by a population-based sample of women without breast cancer on
        Long Island, New York (n = 1,500). Total flavonoid and lignan content of
        food items ranged from 0 to 129 mg/100 g, and the richest sources were
        tea, cherries, and grapefruit. Individual intake estimates, from highest
        to lowest, were flavan-3-ols, flavanones, flavonols, lignans,
        isoflavones, anthocyanidins, and flavones. Each class of flavonoids and
        lignans exhibited a wide range of intake levels. This database is useful
        to quantify flavonoid and lignan intake for other observational studies
        conducted in the United States that utilize the Block FFQ.
      - "passsage: Several prospective studies considered the relation between coffee consumption and mortality. Most studies, however, were underpowered to detect an association, since they included relatively few deaths. To obtain quantitative overall estimates, we combined all published data from prospective studies on the relation of coffee with mortality for all causes, all cancers, cardiovascular disease (CVD), coronary/ischemic heart disease (CHD/IHD) and stroke. A bibliography search, updated to January 2013, was carried out in PubMed and Embase to identify prospective observational studies providing quantitative estimates on mortality from all causes, cancer, CVD, CHD/IHD or stroke in relation to coffee consumption. A systematic review and meta-analysis was conducted to estimate overall relative risks (RR) and 95\_% confidence intervals (CI) using random-effects models. The pooled RRs of all cause mortality for the study-specific highest versus low (≤1 cup/day) coffee drinking categories were 0.88 (95\_% CI 0.84-0.93) based on all the 23 studies, and 0.87 (95\_% CI 0.82-0.93) for the 19 smoking adjusting studies. The combined RRs for CVD mortality were 0.89 (95\_% CI 0.77-1.02, 17 smoking adjusting studies) for the highest versus low drinking and 0.98 (95\_% CI 0.95-1.00, 16 studies) for the increment of 1 cup/day. Compared with low drinking, the RRs for the highest consumption of coffee were 0.95 (95\_% CI 0.78-1.15, 12 smoking adjusting studies) for CHD/IHD, 0.95 (95\_% CI 0.70-1.29, 6 studies) for stroke, and 1.03 (95\_% CI 0.97-1.10, 10 studies) for all cancers. This meta-analysis provides quantitative evidence that coffee intake is inversely related to all cause and, probably, CVD mortality."
  - source_sentence: 'query: Do Flavonoids Help Reduce Heart Disease?'
    sentences:
      - >-
        passsage: Tea (Camellia sinensis, Theaceae) and tea polyphenols have
        been studied for the prevention of chronic diseases, including obesity.
        Obesity currently affects >20% of adults in the United States and is a
        risk factor for chronic diseases such as type II diabetes,
        cardiovascular disease, and cancer. Given this increasing public health
        concern, the use of dietary agents for the prevention of obesity would
        be of tremendous benefit. Whereas many laboratory studies have
        demonstrated the potential efficacy of green or black tea for the
        prevention of obesity, the underlying mechanisms remain unclear. The
        results of human intervention studies are mixed and the role of caffeine
        has not been clearly established. Finally, there is emerging evidence
        that high doses of tea polyphenols may have adverse side effects. Given
        that the results of scientific studies on dietary components, including
        tea polyphenols, are often translated into dietary supplements,
        understanding the potential toxicities of the tea polyphenols is
        critical to understanding their potential usefulness in preventing
        obesity. In this review, we will critically evaluate the evidence for
        the prevention of obesity by tea, discuss the relevance of proposed
        mechanisms in light of tea polyphenol bioavailability, and review the
        reports concerning the toxic effects of high doses of tea polyphenols
        and the implication that this has for the potential use of tea for the
        prevention of obesity. We hope that this review will expose areas for
        further study and encourage research on this important public health
        issue.
      - >-
        passsage: Background & Aims The historical prevalence and long-term
        outcome of undiagnosed celiac disease (CD) are unknown. We investigated
        the long-term outcome of undiagnosed CD and whether the prevalence of
        undiagnosed CD has changed during the past 50 years. Methods This study
        included 9,133 healthy young adults at Warren Air Force Base (sera were
        collected between 1948 and 1954) and 12,768 sex-matched subjects from 2
        recent cohorts from Olmsted County, Minnesota, with either similar years
        of birth (n=5,558) or age at sampling (n=7,210) to that of the Air Force
        cohort. Sera were tested for tissue transglutaminase and, if abnormal,
        for endomysial antibodies. Survival was measured during a follow-up
        period of 45 years in the Air Force cohort. The prevalence of
        undiagnosed CD between the Air Force cohort and recent cohorts was
        compared. Results Of 9,133 persons from the Air Force cohort, 14 (0.2%)
        had undiagnosed CD. In this cohort, during 45 years of follow-up,
        all-cause mortality was greater in persons with undiagnosed CD than
        among those who were seronegative (hazard ratio=3.9; 95% CI, 2.0–7.5;
        P<.001). Undiagnosed CD was found in 68 (0.9%) persons with similar age
        at sampling and 46 (0.8%) persons with similar years of birth. The rate
        of undiagnosed CD was 4.5-fold and 4-fold greater in the recent cohorts
        (respectively) than in the Air Force cohort (both P ≤ .0001).
        Conclusions During 45 years of follow-up, undiagnosed CD was associated
        with a nearly 4-fold increased risk of death. The prevalence of
        undiagnosed CD appears to have increased dramatically in the United
        States during the past 50 years.
      - >-
        passsage: Dietary flavonols and flavones are subgroups of flavonoids
        that have been suggested to decrease the risk of coronary heart disease
        (CHD). The authors prospectively evaluated intakes of flavonols and
        flavones in relation to risk of nonfatal myocardial infarction and fatal
        CHD in the Nurses' Health Study. They assessed dietary information from
        the study's 1990, 1994, and 1998 food frequency questionnaires and
        computed cumulative average intakes of flavonols and flavones. Cox
        proportional hazards regression with time-varying variables was used for
        analysis. During 12 years of follow-up (1990-2002), the authors
        documented 938 nonfatal myocardial infarctions and 324 CHD deaths among
        66,360 women. They observed no association between flavonol or flavone
        intake and risk of nonfatal myocardial infarction or fatal CHD. However,
        a weak risk reduction for CHD death was found among women with a higher
        intake of kaempferol, an individual flavonol found primarily in broccoli
        and tea. Women in the highest quintile of kaempferol intake relative to
        those in the lowest had a multivariate relative risk of 0.66 (95%
        confidence interval: 0.48, 0.93; p for trend = 0.04). The lower risk
        associated with kaempferol intake was probably attributable to broccoli
        consumption. These prospective data do not support an inverse
        association between flavonol or flavone intake and CHD risk.
  - source_sentence: 'query: How Do Leafy Greens Protect Your Eyes?'
    sentences:
      - >-
        passsage: Increasing evidence suggests that acetaldehyde, the first and
        genotoxic metabolite of ethanol, mediates the carcinogenicity of
        alcoholic beverages. Ethanol is also contained in a number of
        ready-to-use mouthwashes typically between 5 and 27% vol. An increased
        risk of oral cancer has been discussed for users of such mouthwashes;
        however, epidemiological evidence had remained inconclusive. This study
        is the first to investigate acetaldehyde levels in saliva after use of
        alcohol-containing mouthwashes. Ready-to-use mouthwashes and mouthrinses
        (n = 13) were rinsed in the mouth by healthy, nonsmoking volunteers (n =
        4) as intended by the manufacturers (20 ml for 30 sec). Saliva was
        collected at 0.5, 2, 5 and 10 min after mouthwash use and analyzed using
        headspace gas chromatography. The acetaldehyde content in the saliva was
        41 +/- 15 microM, range 9-85 microM (0.5 min), 52 +/- 14 microM, range
        11-105 microM (2 min), 32 +/- 7 microM, range 9-67 microM (5 min) and 15
        +/- 7 microM, range 0-37 microM (10 min). The contents were
        significantly above endogenous levels and corresponding to
        concentrations normally found after alcoholic beverage consumption. A
        twice-daily use of alcohol-containing mouthwashes leads to a systemic
        acetaldehyde exposure of 0.26 microg/kg bodyweight/day on average, which
        corresponds to a lifetime cancer risk of 3E-6. The margin of exposure
        was calculated to be 217,604, which would be seen as a low public health
        concern. However, the local acetaldehyde contents in the saliva are
        reaching concentrations associated with DNA adduct formation and sister
        chromatid exchange in vitro, so that concerns for local carcinogenic
        effects in the oral cavity remain.
      - >-
        passsage: Excitement about neurogenetics in the last two decades has
        diverted attention from environmental causes of sporadic ALS. Fifty
        years ago endemic foci of ALS with a frequency one hundred times that in
        the rest of the world attracted attention since they offered the
        possibility of finding the cause for non-endemic ALS throughout the
        world. Research on Guam suggested that ALS, Parkinson's disease and
        dementia (the ALS/PDC complex) was due to a neurotoxic non-protein amino
        acid, beta-methylamino-L-alanine (BMAA), in the seeds of the cycad Cycas
        micronesica. Recent discoveries that found that BMAA is produced by
        symbiotic cyanobacteria within specialized roots of the cycads; that the
        concentration of protein-bound BMAA is up to a hundred-fold greater than
        free BMAA in the seeds and flour; that various animals forage on the
        seeds (flying foxes, pigs, deer), leading to biomagnification up the
        food chain in Guam; and that protein-bound BMAA occurs in the brains of
        Guamanians dying of ALS/PDC (average concentration 627 microg/g, 5 mM)
        but not in control brains have rekindled interest in BMAA as a possible
        trigger for Guamanian ALS/PDC. Perhaps most intriguing is the finding
        that BMAA is present in brain tissues of North American patients who had
        died of Alzheimer's disease (average concentration 95 microg/g, 0.8mM);
        this suggests a possible etiological role for BMAA in non-Guamanian
        neurodegenerative diseases. Cyanobacteria are ubiquitous throughout the
        world, so it is possible that all humans are exposed to low amounts of
        cyanobacterial BMAA, that protein-bound BMAA in human brains is a
        reservoir for chronic neurotoxicity, and that cyanobacterial BMAA is a
        major cause of progressive neurodegenerative diseases including ALS
        worldwide. Though Montine et al., using different HPLC method and assay
        techniques from those used by Cox and colleagues, were unable to
        reproduce the findings of Murch et al., Mash and colleagues using the
        original techniques of Murch et al. have recently confirmed the presence
        of protein-bound BMAA in the brains of North American patients dying
        with ALS and Alzheimer's disease (concentrations >100 microg/g) but not
        in the brains of non-neurological controls or Huntington's disease. We
        hypothesize that individuals who develop neurodegenerations may have a
        genetic susceptibility because of inability to prevent BMAA accumulation
        in brain proteins and that the particular pattern of neurodegeneration
        that develops depends on the polygenic background of the individual.
      - >-
        passsage: PURPOSE: To explore the association between the consumption of
        fruits and vegetables and the presence of glaucoma. DESIGN:
        Cross-sectional cohort study. METHODS: In a sample of 1,155 women
        located in multiple centers in the United States, glaucoma specialists
        diagnosed glaucoma in at least one eye by assessing optic nerve head
        photographs and 76-point suprathreshold screening visual fields.
        Consumption of fruits and vegetables was assessed using the Block Food
        Frequency Questionnaire. The relationship between selected fruit and
        vegetable consumption and glaucoma was investigated using adjusted
        logistic regression models. RESULTS: Among 1,155 women, 95 (8.2%) were
        diagnosed with glaucoma. In adjusted analysis, the odds of glaucoma risk
        were decreased by 69% (odds ratio [OR], 0.31; 95% confidence interval
        [CI], 0.11 to 0.91) in women who consumed at least one serving per month
        of green collards and kale compared with those who consumed fewer than
        one serving per month, by 64% (OR, 0.36; 95% CI, 0.17 to 0.77) in women
        who consumed more than two servings per week of carrots compared with
        those who consumed fewer than one serving per week, and by 47% (OR,
        0.53; 95% CI, 0.29 to 0.97) in women who consumed at least one serving
        per week of canned or dried peaches compared with those who consumed
        fewer than one serving per month. CONCLUSIONS: A higher intake of
        certain fruits and vegetables may be associated with a decreased risk of
        glaucoma. More studies are needed to investigate this relationship.
  - source_sentence: 'query: How Much Isoflavones Do I Need to Reduce Ovarian Cancer Risk?'
    sentences:
      - >-
        passsage: It is likely that plant food consumption throughout much of
        human evolution shaped the dietary requirements of contemporary humans.
        Diets would have been high in dietary fiber, vegetable protein, plant
        sterols and associated phytochemicals, and low in saturated and
        trans-fatty acids and other substrates for cholesterol biosynthesis. To
        meet the body's needs for cholesterol, we believe genetic differences
        and polymorphisms were conserved by evolution, which tended to raise
        serum cholesterol levels. As a result modern man, with a radically
        different diet and lifestyle, especially in middle age, is now
        recommended to take medications to lower cholesterol and reduce the risk
        of cardiovascular disease. Experimental introduction of high intakes of
        viscous fibers, vegetable proteins and plant sterols in the form of a
        possible Myocene diet of leafy vegetables, fruit and nuts, lowered serum
        LDL-cholesterol in healthy volunteers by over 30%, equivalent to first
        generation statins, the standard cholesterol-lowering medications.
        Furthermore, supplementation of a modern therapeutic diet in
        hyperlipidemic subjects with the same components taken as oat, barley
        and psyllium for viscous fibers, soy and almonds for vegetable proteins
        and plant sterol-enriched margarine produced similar reductions in
        LDL-cholesterol as the Myocene-like diet and reduced the majority of
        subjects' blood lipids concentrations into the normal range. We conclude
        that reintroduction of plant food components, which would have been
        present in large quantities in the plant based diets eaten throughout
        most of human evolution into modern diets can correct the lipid
        abnormalities associated with contemporary eating patterns and reduce
        the need for pharmacological interventions.
      - >-
        passsage: Liquid dietary supplements represent a fast growing market
        segment, including botanically-based beverages containing mangosteen,
        acai, and noni. These products often resemble fruit juice in packaging
        and appearance, but may contain pharmacologically active ingredients.
        While little is known about the human health effects or safety of
        consuming such products, manufacturers make extensive use of low-quality
        published research to promote their products. This report analyzes the
        science-based marketing claims of two of the most widely consumed
        mangosteen liquid dietary supplements, and compares them to the findings
        of the research being cited. The reviewer found that analyzed marketing
        claims overstate the significance of findings, and fail to disclose
        severe methodological weaknesses of the research they cite. If this
        trend extends to other related products that are similarly widely
        consumed, it may pose a public health threat by misleading consumers
        into assuming that product safety and effectiveness are backed by
        rigorous scientific data.
      - >-
        passsage: Dietary phytochemical compounds, including isoflavones and
        isothiocyanates, may inhibit cancer development but have not yet been
        examined in prospective epidemiologic studies of ovarian cancer. The
        authors have investigated the association between consumption of these
        and other nutrients and ovarian cancer risk in a prospective cohort
        study. Among 97,275 eligible women in the California Teachers Study
        cohort who completed the baseline dietary assessment in 1995–1996, 280
        women developed invasive or borderline ovarian cancer by December 31,
        2003. Multivariable Cox proportional hazards regression, with age as the
        timescale, was used to estimate relative risks and 95% confidence
        intervals; all statistical tests were two sided. Intake of isoflavones
        was associated with lower risk of ovarian cancer. Compared with the risk
        for women who consumed less than 1 mg of total isoflavones per day, the
        relative risk of ovarian cancer associated with consumption of more than
        3 mg/day was 0.56 (95% confidence interval: 0.33, 0.96). Intake of
        isothiocyanates or foods high in isothiocyanates was not associated with
        ovarian cancer risk, nor was intake of macronutrients, antioxidant
        vitamins, or other micronutrients. Although dietary consumption of
        isoflavones may be associated with decreased ovarian cancer risk, most
        dietary factors are unlikely to play a major role in ovarian cancer
        development.
pipeline_tag: sentence-similarity
library_name: sentence-transformers

SentenceTransformer based on intfloat/e5-small-v2

This is a sentence-transformers model finetuned from intfloat/e5-small-v2. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: intfloat/e5-small-v2
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'query: How Much Isoflavones Do I Need to Reduce Ovarian Cancer Risk?',
    'passsage: Dietary phytochemical compounds, including isoflavones and isothiocyanates, may inhibit cancer development but have not yet been examined in prospective epidemiologic studies of ovarian cancer. The authors have investigated the association between consumption of these and other nutrients and ovarian cancer risk in a prospective cohort study. Among 97,275 eligible women in the California Teachers Study cohort who completed the baseline dietary assessment in 1995–1996, 280 women developed invasive or borderline ovarian cancer by December 31, 2003. Multivariable Cox proportional hazards regression, with age as the timescale, was used to estimate relative risks and 95% confidence intervals; all statistical tests were two sided. Intake of isoflavones was associated with lower risk of ovarian cancer. Compared with the risk for women who consumed less than 1 mg of total isoflavones per day, the relative risk of ovarian cancer associated with consumption of more than 3 mg/day was 0.56 (95% confidence interval: 0.33, 0.96). Intake of isothiocyanates or foods high in isothiocyanates was not associated with ovarian cancer risk, nor was intake of macronutrients, antioxidant vitamins, or other micronutrients. Although dietary consumption of isoflavones may be associated with decreased ovarian cancer risk, most dietary factors are unlikely to play a major role in ovarian cancer development.',
    "passsage: It is likely that plant food consumption throughout much of human evolution shaped the dietary requirements of contemporary humans. Diets would have been high in dietary fiber, vegetable protein, plant sterols and associated phytochemicals, and low in saturated and trans-fatty acids and other substrates for cholesterol biosynthesis. To meet the body's needs for cholesterol, we believe genetic differences and polymorphisms were conserved by evolution, which tended to raise serum cholesterol levels. As a result modern man, with a radically different diet and lifestyle, especially in middle age, is now recommended to take medications to lower cholesterol and reduce the risk of cardiovascular disease. Experimental introduction of high intakes of viscous fibers, vegetable proteins and plant sterols in the form of a possible Myocene diet of leafy vegetables, fruit and nuts, lowered serum LDL-cholesterol in healthy volunteers by over 30%, equivalent to first generation statins, the standard cholesterol-lowering medications. Furthermore, supplementation of a modern therapeutic diet in hyperlipidemic subjects with the same components taken as oat, barley and psyllium for viscous fibers, soy and almonds for vegetable proteins and plant sterol-enriched margarine produced similar reductions in LDL-cholesterol as the Myocene-like diet and reduced the majority of subjects' blood lipids concentrations into the normal range. We conclude that reintroduction of plant food components, which would have been present in large quantities in the plant based diets eaten throughout most of human evolution into modern diets can correct the lipid abnormalities associated with contemporary eating patterns and reduce the need for pharmacological interventions.",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[ 1.0000,  0.8492,  0.0442],
#         [ 0.8492,  1.0000, -0.0126],
#         [ 0.0442, -0.0126,  1.0000]])

Training Details

Training Dataset

Unnamed Dataset

• Size: 26,136 training samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 7 tokens mean: 12.9 tokens max: 27 tokens	min: 25 tokens mean: 331.4 tokens max: 512 tokens

• Samples:

  anchor	positive
  query: Does Turmeric Help With Ulcers?	passsage: The purpose of this review is to summarize the pertinent literature published in the present era regarding the antiulcerogenic property of curcumin against the pathological changes in response to ulcer effectors (Helicobacter pylori infection, chronic ingestion of non-steroidal anti-inflammatory drugs, and exogenous substances). The gastrointestinal problems caused by different etiologies was observed to be associated with the alterations of various physiologic parameters such as reactive oxygen species, nitric oxide synthase, lipid peroxidation, and secretion of excessive gastric acid. Gastrointestinal ulcer results probably due to imbalance between the aggressive and the defensive factors. In 80% of the cases, gastric ulcer is caused primarily due to the use of non-steroidal anti-inflammatory category of drug, 10% by H. pylori, and about 8-10% by the intake of very spicy and fast food. Although a number of antiulcer drugs and cytoprotectants are available, all these drugs h...
  query: What Are the Dangers of Environmental Toxins for Men's Reproductive Health?	passsage: Male reproductive disorders that are of interest from an environmental point of view include sexual dysfunction, infertility, cryptorchidism, hypospadias and testicular cancer. Several reports suggest declining sperm counts and increase of these reproductive disorders in some areas during some time periods past 50 years. Except for testicular cancer this evidence is circumstantial and needs cautious interpretation. However, the male germ line is one of the most sensitive tissues to the damaging effects of ionizing radiation, radiant heat and a number of known toxicants. So far occupational hazards are the best documented risk factors for impaired male reproductive function and include physical exposures (radiant heat, ionizing radiation, high frequency electromagnetic radiation), chemical exposures (some solvents as carbon disulfide and ethylene glycol ethers, some pesticides as dibromochloropropane, ethylendibromide and DDT/DDE, some heavy metals as inorganic lead and mercur...
  query: Does Flaxseed Help Lower Blood Pressure?	passsage: Flaxseed contains ω-3 fatty acids, lignans, and fiber that together may provide benefits to patients with cardiovascular disease. Animal work identified that patients with peripheral artery disease may particularly benefit from dietary supplementation with flaxseed. Hypertension is commonly associated with peripheral artery disease. The purpose of the study was to examine the effects of daily ingestion of flaxseed on systolic (SBP) and diastolic blood pressure (DBP) in peripheral artery disease patients. In this prospective, double-blinded, placebo-controlled, randomized trial, patients (110 in total) ingested a variety of foods that contained 30 g of milled flaxseed or placebo each day over 6 months. Plasma levels of the ω-3 fatty acid α-linolenic acid and enterolignans increased 2- to 50-fold in the flaxseed-fed group but did not increase significantly in the placebo group. Patient body weights were not significantly different between the 2 groups at any time. SBP was ≈ 10 ...

• Loss: CachedMultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "mini_batch_size": 16,
      "gather_across_devices": false
  }
  

Evaluation Dataset

Unnamed Dataset

• Size: 2,904 evaluation samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 7 tokens mean: 13.08 tokens max: 27 tokens	min: 23 tokens mean: 335.36 tokens max: 512 tokens

• Samples:

  anchor	positive
  query: Does Diet Reduce Alzheimer's Risk?	passsage: BACKGROUND: Numerous studies have investigated risk factors for Alzheimer disease (AD). However, at a recent National Institutes of Health State-of-the-Science Conference, an independent panel found insufficient evidence to support the association of any modifiable factor with risk of cognitive decline or AD. OBJECTIVE: To present key findings for selected factors and AD risk that led the panel to their conclusion. DATA SOURCES: An evidence report was commissioned by the Agency for Healthcare Research and Quality. It included English-language publications in MEDLINE and the Cochrane Database of Systematic Reviews from 1984 through October 27, 2009. Expert presentations and public discussions were considered. STUDY SELECTION: Study inclusion criteria for the evidence report were participants aged 50 years and older from general populations in developed countries; minimum sample sizes of 300 for cohort studies and 50 for randomized controlled trials; at least 2 years between ex...
  query: Is Spam Bad For Your Diabetes?	passsage: Background: Fifty percent of American Indians (AIs) develop diabetes by age 55 y. Whether processed meat is associated with the risk of diabetes in AIs, a rural population with a high intake of processed meat (eg, canned meats in general, referred to as “spam”) and a high rate of diabetes, is unknown. Objective: We examined the associations of usual intake of processed meat with incident diabetes in AIs. Design: This prospective cohort study included AI participants from the Strong Heart Family Study who were free of diabetes and cardiovascular disease at baseline and who participated in a 5-y follow-up examination (n = 2001). Dietary intake was ascertained by using a Block food-frequency questionnaire at baseline. Incident diabetes was defined on the basis of 2003 American Diabetes Association criteria. Generalized estimating equations were used to examine the associations of dietary intake with incident diabetes. Results: We identified 243 incident cases of diabetes. In a c...
  query: Is Vitamin D Good For Cancer Prevention?	passsage: Observational and ecological studies are generally used to determine the presence of effect of cancer risk-modifying factors. Researchers generally agree that environmental factors such as smoking, alcohol consumption, poor diet, lack of physical activity, and low serum 25-hdyroxyvitamin D levels are important cancer risk factors. This ecological study used age-adjusted incidence rates for 21 cancers for 157 countries (87 with high-quality data) in 2008 with respect to dietary supply and other factors, including per capita gross domestic product, life expectancy, lung cancer incidence rate (an index for smoking), and latitude (an index for solar ultraviolet-B doses). The factors found to correlate strongly with multiple types of cancer were lung cancer (direct correlation with 12 types of cancer), energy derived from animal products (direct correlation with 12 types of cancer, inverse with two), latitude (direct correlation with six types, inverse correlation with three), and...

• Loss: CachedMultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "mini_batch_size": 16,
      "gather_across_devices": false
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 128
• learning_rate: 2e-05
• num_train_epochs: 30
• warmup_ratio: 0.1
• fp16: True
• load_best_model_at_end: True
• batch_sampler: no_duplicates

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: epoch
• prediction_loss_only: True
• per_device_train_batch_size: 128
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 2e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 30
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• bf16: False
• fp16: True
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: True
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch_fused
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• prompts: None
• batch_sampler: no_duplicates
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	Validation Loss
1.0	205	1.4561	0.0201
2.0	410	0.1947	0.0127
3.0	615	0.1403	0.0114
4.0	820	0.1137	0.0088
5.0	1025	0.0911	0.0080
6.0	1230	0.0818	0.0084
7.0	1435	0.0734	0.0078
8.0	1640	0.067	0.0076
9.0	1845	0.0607	0.0082
10.0	2050	0.0553	0.0073
11.0	2255	0.0526	0.0065
12.0	2460	0.0505	0.0066
13.0	2665	0.0505	0.0063
14.0	2870	0.0466	0.0060
15.0	3075	0.0448	0.0063
16.0	3280	0.045	0.0060
17.0	3485	0.0417	0.0057
18.0	3690	0.0395	0.0057
19.0	3895	0.0425	0.0065
20.0	4100	0.0379	0.0058
21.0	4305	0.0389	0.0055
22.0	4510	0.0394	0.0055
23.0	4715	0.0351	0.0057
24.0	4920	0.0359	0.0054
25.0	5125	0.0366	0.0054
26.0	5330	0.0356	0.0055
27.0	5535	0.0347	0.0055
28.0	5740	0.0346	0.0054

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.12.12
• Sentence Transformers: 5.1.2
• Transformers: 4.57.1
• PyTorch: 2.8.0+cu126
• Accelerate: 1.11.0
• Datasets: 4.0.0
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CachedMultipleNegativesRankingLoss

@misc{gao2021scaling,
    title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
    author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
    year={2021},
    eprint={2101.06983},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}