| --- |
| tags: |
| - sentence-transformers |
| - sentence-similarity |
| - feature-extraction |
| - dense |
| - generated_from_trainer |
| - dataset_size:26136 |
| - loss:CachedMultipleNegativesRankingLoss |
| base_model: intfloat/e5-small-v2 |
| widget: |
| - source_sentence: 'query: Do Artificial Food Dyes Cause ADHD?' |
| sentences: |
| - 'passsage: It has become widely accepted that Type 2 diabetes is inevitably life-long, |
| with irreversible and progressive beta cell damage. However, the restoration of |
| normal glucose metabolism within days after bariatric surgery in the majority |
| of people with Type 2 diabetes disproves this concept. There is now no doubt that |
| this reversal of diabetes depends upon the sudden and profound decrease in food |
| intake, and does not relate to any direct surgical effect. The Counterpoint study |
| demonstrated that normal glucose levels and normal beta cell function could be |
| restored by a very low calorie diet alone. Novel magnetic resonance methods were |
| applied to measure intra-organ fat. The results showed two different time courses: |
| a) resolution of hepatic insulin sensitivity within days along with a rapid fall |
| in liver fat and normalisation of fasting glucose levels; and b) return of normal |
| beta cell insulin secretion over weeks in step with a fall in pancreas fat. Now |
| that it has been possible to observe the pathophysiological events during reversal |
| of Type 2 diabetes, the reverse time course of events which determine the onset |
| of the condition can be identified. The twin cycle hypothesis postulates that |
| chronic calorie excess leads to accumulation of liver fat with eventual spill |
| over into the pancreas. These self-reinforcing cycles between liver and pancreas |
| eventually cause metabolic inhibition of insulin secretion after meals and onset |
| of hyperglycaemia. It is now clear that Type 2 diabetes is a reversible condition |
| of intra-organ fat excess to which some people are more susceptible than others.' |
| - 'passsage: A great deal of effort is now being devoted to the development of new |
| drugs that hopefully will control the spread of inoperable cancer by safely inhibiting |
| tumor-evoked angiogenesis. However, there is growing evidence that certain practical |
| nutritional measures have the potential to slow tumor angiogenesis, and it is |
| reasonable to anticipate that, by combining several measures that work in distinct |
| but complementary ways to impede the angiogenic process, a clinically useful ''multifocal |
| angiostatic therapy'' (MAT) might be devised. Several measures which might reasonably |
| be included in such a protocol are discussed below, and include: a low-fat, low-glycemic |
| index vegan diet, which may down-regulate the systemic IGF-I activity that supports |
| angiogenesis; supplemental omega-3-rich fish oil, which has been shown to inhibit |
| endothelial expression of Flk-1, a functionally crucial receptor for VEGF, and |
| also can suppress tumor production of pro-angiogenic eicosanoids; high-dose selenium, |
| which has recently been shown to inhibit tumor production of VEGF; green tea polyphenols, |
| which can suppress endothelial responsiveness to both VEGF and fibroblast growth |
| factor; and high-dose glycine, whose recently reported angiostatic activity may |
| reflect inhibition of endothelial cell mitosis, possibly mediated by activation |
| of glycine-gated chloride channels. In light of evidence that tumor-evoked angiogenesis |
| has a high requirement for copper, copper depletion may have exceptional potential |
| as an angiostatic measure, and is most efficiently achieved with the copper-chelating |
| drug tetrathiomolybdate. If logistical difficulties make it difficult to acquire |
| this experimental drug, high-dose zinc supplementation can achieve a slower depletion |
| of the body''s copper pool, and in any case can be used as maintenance therapy |
| to maintain an adequate level of copper depletion. A provisional protocol is offered |
| for a nutritionally based MAT entailing a vegan diet and supplemental intakes |
| of fish oil, selenium, green tea polyphenols, glycine, and zinc. Inasmuch as cox-2 |
| is overexpressed in many cancers, and cAMP can boost tumor production of various |
| angiogenic factors as well as autogenous growth factors, adjunctive use of cox-2-specific |
| NSAIDS may be warranted in some cases.' |
| - 'passsage: Attention deficit hyperactivity disorder (ADHD) is one of the most |
| common behavioral disorders in children. Symptoms of ADHD include hyperactivity, |
| low frustration tolerance, impulsivity, and inattention. While the biological |
| pathways leading to ADHD are not clearly delineated, a number of genetic and environmental |
| risk factors for the disorder are recognized. In the early 1970s, research conducted |
| by Dr. Benjamin Feingold found that when hyperactive children were given a diet |
| free of artificial food additives and dyes, symptoms of hyperactivity were reduced. |
| While some clinical studies supported these findings, more rigorous empirical |
| studies conducted over the next 20 years were less positive. As a result, research |
| on the role of food additives in contributing to ADHD waned. In recent years, |
| however, interest in this area has revived. In response to more recent research |
| and public petitions, in December 2009 the British government requested that food |
| manufacturers remove most artificial food dyes from their products. While these |
| strictures could have positive effects on behavior, the removal of food dyes is |
| not a panacea for ADHD, which is a multifaceted disorder with both biological |
| and environmental underpinnings. © 2011 International Life Sciences Institute.' |
| - source_sentence: 'query: Is HDL High in Active Africans?' |
| sentences: |
| - 'passsage: The serum concentration of high-density lipoprotein cholesterol and |
| the proportion it constitutes of total serum cholesterol are high in children |
| and low in sufferers from coronary heart disease (CHD). Studies in elderly black |
| Africans in Western Transvaal showed them to be free of CHD. HDL concentrations |
| measured at birth and in groups of 10- to 12-year-olds, 16- to 18-year olds, and |
| 60- to 69-year-olds showed mean values of 0.96, 1.71, 1.58, and 1.94 mmol/l (36, |
| 66, 61, and 65 mg/100 ml) respectively; these concentrations constitued about |
| 56%, 54%, and 45%, and 47%, of total cholesterol. Values thus did not fall from |
| youth to age as they did in whites. Rural South African blacks live on a diet |
| high in fibre and low in animal protein and fat; children are active; and adults |
| remain active even when old. These high values of HDL may well be representative |
| for a population that is active, used to a frugal traditional diet, and free from |
| CHD.' |
| - 'passsage: Flavonoids have been hypothesized to reduce cancer risk. Previous epidemiological |
| studies conducted to evaluate this hypothesis have not assessed all flavonoids, |
| including classes that could contribute to intake among Americans, which would |
| result in an underestimation of intake. This misclassification could mask variability |
| among individuals, resulting in attenuated effect estimates for the association |
| between flavonoids and cancer. To augment flavonoid and lignan intake estimates, |
| we developed a database that can be used in conjunction with a food-frequency |
| questionnaire (FFQ). Coupling information derived from the available literature |
| with the U.S. Department of Agriculture databases, we estimated content of 6 flavonoid |
| classes and lignans for 50 food group items. We combined these estimates with |
| responses from a modified Block FFQ that was self-completed in 1996-1997 by a |
| population-based sample of women without breast cancer on Long Island, New York |
| (n = 1,500). Total flavonoid and lignan content of food items ranged from 0 to |
| 129 mg/100 g, and the richest sources were tea, cherries, and grapefruit. Individual |
| intake estimates, from highest to lowest, were flavan-3-ols, flavanones, flavonols, |
| lignans, isoflavones, anthocyanidins, and flavones. Each class of flavonoids and |
| lignans exhibited a wide range of intake levels. This database is useful to quantify |
| flavonoid and lignan intake for other observational studies conducted in the United |
| States that utilize the Block FFQ.' |
| - 'passsage: Several prospective studies considered the relation between coffee |
| consumption and mortality. Most studies, however, were underpowered to detect |
| an association, since they included relatively few deaths. To obtain quantitative |
| overall estimates, we combined all published data from prospective studies on |
| the relation of coffee with mortality for all causes, all cancers, cardiovascular |
| disease (CVD), coronary/ischemic heart disease (CHD/IHD) and stroke. A bibliography |
| search, updated to January 2013, was carried out in PubMed and Embase to identify |
| prospective observational studies providing quantitative estimates on mortality |
| from all causes, cancer, CVD, CHD/IHD or stroke in relation to coffee consumption. |
| A systematic review and meta-analysis was conducted to estimate overall relative |
| risks (RR) and 95 % confidence intervals (CI) using random-effects models. The |
| pooled RRs of all cause mortality for the study-specific highest versus low (≤1 |
| cup/day) coffee drinking categories were 0.88 (95 % CI 0.84-0.93) based on all |
| the 23 studies, and 0.87 (95 % CI 0.82-0.93) for the 19 smoking adjusting studies. |
| The combined RRs for CVD mortality were 0.89 (95 % CI 0.77-1.02, 17 smoking adjusting |
| studies) for the highest versus low drinking and 0.98 (95 % CI 0.95-1.00, 16 studies) |
| for the increment of 1 cup/day. Compared with low drinking, the RRs for the highest |
| consumption of coffee were 0.95 (95 % CI 0.78-1.15, 12 smoking adjusting studies) |
| for CHD/IHD, 0.95 (95 % CI 0.70-1.29, 6 studies) for stroke, and 1.03 (95 % CI |
| 0.97-1.10, 10 studies) for all cancers. This meta-analysis provides quantitative |
| evidence that coffee intake is inversely related to all cause and, probably, CVD |
| mortality.' |
| - source_sentence: 'query: Do Flavonoids Help Reduce Heart Disease?' |
| sentences: |
| - 'passsage: Tea (Camellia sinensis, Theaceae) and tea polyphenols have been studied |
| for the prevention of chronic diseases, including obesity. Obesity currently affects |
| >20% of adults in the United States and is a risk factor for chronic diseases |
| such as type II diabetes, cardiovascular disease, and cancer. Given this increasing |
| public health concern, the use of dietary agents for the prevention of obesity |
| would be of tremendous benefit. Whereas many laboratory studies have demonstrated |
| the potential efficacy of green or black tea for the prevention of obesity, the |
| underlying mechanisms remain unclear. The results of human intervention studies |
| are mixed and the role of caffeine has not been clearly established. Finally, |
| there is emerging evidence that high doses of tea polyphenols may have adverse |
| side effects. Given that the results of scientific studies on dietary components, |
| including tea polyphenols, are often translated into dietary supplements, understanding |
| the potential toxicities of the tea polyphenols is critical to understanding their |
| potential usefulness in preventing obesity. In this review, we will critically |
| evaluate the evidence for the prevention of obesity by tea, discuss the relevance |
| of proposed mechanisms in light of tea polyphenol bioavailability, and review |
| the reports concerning the toxic effects of high doses of tea polyphenols and |
| the implication that this has for the potential use of tea for the prevention |
| of obesity. We hope that this review will expose areas for further study and encourage |
| research on this important public health issue.' |
| - 'passsage: Background & Aims The historical prevalence and long-term outcome of |
| undiagnosed celiac disease (CD) are unknown. We investigated the long-term outcome |
| of undiagnosed CD and whether the prevalence of undiagnosed CD has changed during |
| the past 50 years. Methods This study included 9,133 healthy young adults at Warren |
| Air Force Base (sera were collected between 1948 and 1954) and 12,768 sex-matched |
| subjects from 2 recent cohorts from Olmsted County, Minnesota, with either similar |
| years of birth (n=5,558) or age at sampling (n=7,210) to that of the Air Force |
| cohort. Sera were tested for tissue transglutaminase and, if abnormal, for endomysial |
| antibodies. Survival was measured during a follow-up period of 45 years in the |
| Air Force cohort. The prevalence of undiagnosed CD between the Air Force cohort |
| and recent cohorts was compared. Results Of 9,133 persons from the Air Force cohort, |
| 14 (0.2%) had undiagnosed CD. In this cohort, during 45 years of follow-up, all-cause |
| mortality was greater in persons with undiagnosed CD than among those who were |
| seronegative (hazard ratio=3.9; 95% CI, 2.0–7.5; P<.001). Undiagnosed CD was found |
| in 68 (0.9%) persons with similar age at sampling and 46 (0.8%) persons with similar |
| years of birth. The rate of undiagnosed CD was 4.5-fold and 4-fold greater in |
| the recent cohorts (respectively) than in the Air Force cohort (both P ≤ .0001). |
| Conclusions During 45 years of follow-up, undiagnosed CD was associated with a |
| nearly 4-fold increased risk of death. The prevalence of undiagnosed CD appears |
| to have increased dramatically in the United States during the past 50 years.' |
| - 'passsage: Dietary flavonols and flavones are subgroups of flavonoids that have |
| been suggested to decrease the risk of coronary heart disease (CHD). The authors |
| prospectively evaluated intakes of flavonols and flavones in relation to risk |
| of nonfatal myocardial infarction and fatal CHD in the Nurses'' Health Study. |
| They assessed dietary information from the study''s 1990, 1994, and 1998 food |
| frequency questionnaires and computed cumulative average intakes of flavonols |
| and flavones. Cox proportional hazards regression with time-varying variables |
| was used for analysis. During 12 years of follow-up (1990-2002), the authors documented |
| 938 nonfatal myocardial infarctions and 324 CHD deaths among 66,360 women. They |
| observed no association between flavonol or flavone intake and risk of nonfatal |
| myocardial infarction or fatal CHD. However, a weak risk reduction for CHD death |
| was found among women with a higher intake of kaempferol, an individual flavonol |
| found primarily in broccoli and tea. Women in the highest quintile of kaempferol |
| intake relative to those in the lowest had a multivariate relative risk of 0.66 |
| (95% confidence interval: 0.48, 0.93; p for trend = 0.04). The lower risk associated |
| with kaempferol intake was probably attributable to broccoli consumption. These |
| prospective data do not support an inverse association between flavonol or flavone |
| intake and CHD risk.' |
| - source_sentence: 'query: How Do Leafy Greens Protect Your Eyes?' |
| sentences: |
| - 'passsage: Increasing evidence suggests that acetaldehyde, the first and genotoxic |
| metabolite of ethanol, mediates the carcinogenicity of alcoholic beverages. Ethanol |
| is also contained in a number of ready-to-use mouthwashes typically between 5 |
| and 27% vol. An increased risk of oral cancer has been discussed for users of |
| such mouthwashes; however, epidemiological evidence had remained inconclusive. |
| This study is the first to investigate acetaldehyde levels in saliva after use |
| of alcohol-containing mouthwashes. Ready-to-use mouthwashes and mouthrinses (n |
| = 13) were rinsed in the mouth by healthy, nonsmoking volunteers (n = 4) as intended |
| by the manufacturers (20 ml for 30 sec). Saliva was collected at 0.5, 2, 5 and |
| 10 min after mouthwash use and analyzed using headspace gas chromatography. The |
| acetaldehyde content in the saliva was 41 +/- 15 microM, range 9-85 microM (0.5 |
| min), 52 +/- 14 microM, range 11-105 microM (2 min), 32 +/- 7 microM, range 9-67 |
| microM (5 min) and 15 +/- 7 microM, range 0-37 microM (10 min). The contents were |
| significantly above endogenous levels and corresponding to concentrations normally |
| found after alcoholic beverage consumption. A twice-daily use of alcohol-containing |
| mouthwashes leads to a systemic acetaldehyde exposure of 0.26 microg/kg bodyweight/day |
| on average, which corresponds to a lifetime cancer risk of 3E-6. The margin of |
| exposure was calculated to be 217,604, which would be seen as a low public health |
| concern. However, the local acetaldehyde contents in the saliva are reaching concentrations |
| associated with DNA adduct formation and sister chromatid exchange in vitro, so |
| that concerns for local carcinogenic effects in the oral cavity remain.' |
| - 'passsage: Excitement about neurogenetics in the last two decades has diverted |
| attention from environmental causes of sporadic ALS. Fifty years ago endemic foci |
| of ALS with a frequency one hundred times that in the rest of the world attracted |
| attention since they offered the possibility of finding the cause for non-endemic |
| ALS throughout the world. Research on Guam suggested that ALS, Parkinson''s disease |
| and dementia (the ALS/PDC complex) was due to a neurotoxic non-protein amino acid, |
| beta-methylamino-L-alanine (BMAA), in the seeds of the cycad Cycas micronesica. |
| Recent discoveries that found that BMAA is produced by symbiotic cyanobacteria |
| within specialized roots of the cycads; that the concentration of protein-bound |
| BMAA is up to a hundred-fold greater than free BMAA in the seeds and flour; that |
| various animals forage on the seeds (flying foxes, pigs, deer), leading to biomagnification |
| up the food chain in Guam; and that protein-bound BMAA occurs in the brains of |
| Guamanians dying of ALS/PDC (average concentration 627 microg/g, 5 mM) but not |
| in control brains have rekindled interest in BMAA as a possible trigger for Guamanian |
| ALS/PDC. Perhaps most intriguing is the finding that BMAA is present in brain |
| tissues of North American patients who had died of Alzheimer''s disease (average |
| concentration 95 microg/g, 0.8mM); this suggests a possible etiological role for |
| BMAA in non-Guamanian neurodegenerative diseases. Cyanobacteria are ubiquitous |
| throughout the world, so it is possible that all humans are exposed to low amounts |
| of cyanobacterial BMAA, that protein-bound BMAA in human brains is a reservoir |
| for chronic neurotoxicity, and that cyanobacterial BMAA is a major cause of progressive |
| neurodegenerative diseases including ALS worldwide. Though Montine et al., using |
| different HPLC method and assay techniques from those used by Cox and colleagues, |
| were unable to reproduce the findings of Murch et al., Mash and colleagues using |
| the original techniques of Murch et al. have recently confirmed the presence of |
| protein-bound BMAA in the brains of North American patients dying with ALS and |
| Alzheimer''s disease (concentrations >100 microg/g) but not in the brains of non-neurological |
| controls or Huntington''s disease. We hypothesize that individuals who develop |
| neurodegenerations may have a genetic susceptibility because of inability to prevent |
| BMAA accumulation in brain proteins and that the particular pattern of neurodegeneration |
| that develops depends on the polygenic background of the individual.' |
| - 'passsage: PURPOSE: To explore the association between the consumption of fruits |
| and vegetables and the presence of glaucoma. DESIGN: Cross-sectional cohort study. |
| METHODS: In a sample of 1,155 women located in multiple centers in the United |
| States, glaucoma specialists diagnosed glaucoma in at least one eye by assessing |
| optic nerve head photographs and 76-point suprathreshold screening visual fields. |
| Consumption of fruits and vegetables was assessed using the Block Food Frequency |
| Questionnaire. The relationship between selected fruit and vegetable consumption |
| and glaucoma was investigated using adjusted logistic regression models. RESULTS: |
| Among 1,155 women, 95 (8.2%) were diagnosed with glaucoma. In adjusted analysis, |
| the odds of glaucoma risk were decreased by 69% (odds ratio [OR], 0.31; 95% confidence |
| interval [CI], 0.11 to 0.91) in women who consumed at least one serving per month |
| of green collards and kale compared with those who consumed fewer than one serving |
| per month, by 64% (OR, 0.36; 95% CI, 0.17 to 0.77) in women who consumed more |
| than two servings per week of carrots compared with those who consumed fewer than |
| one serving per week, and by 47% (OR, 0.53; 95% CI, 0.29 to 0.97) in women who |
| consumed at least one serving per week of canned or dried peaches compared with |
| those who consumed fewer than one serving per month. CONCLUSIONS: A higher intake |
| of certain fruits and vegetables may be associated with a decreased risk of glaucoma. |
| More studies are needed to investigate this relationship.' |
| - source_sentence: 'query: How Much Isoflavones Do I Need to Reduce Ovarian Cancer |
| Risk?' |
| sentences: |
| - 'passsage: It is likely that plant food consumption throughout much of human evolution |
| shaped the dietary requirements of contemporary humans. Diets would have been |
| high in dietary fiber, vegetable protein, plant sterols and associated phytochemicals, |
| and low in saturated and trans-fatty acids and other substrates for cholesterol |
| biosynthesis. To meet the body''s needs for cholesterol, we believe genetic differences |
| and polymorphisms were conserved by evolution, which tended to raise serum cholesterol |
| levels. As a result modern man, with a radically different diet and lifestyle, |
| especially in middle age, is now recommended to take medications to lower cholesterol |
| and reduce the risk of cardiovascular disease. Experimental introduction of high |
| intakes of viscous fibers, vegetable proteins and plant sterols in the form of |
| a possible Myocene diet of leafy vegetables, fruit and nuts, lowered serum LDL-cholesterol |
| in healthy volunteers by over 30%, equivalent to first generation statins, the |
| standard cholesterol-lowering medications. Furthermore, supplementation of a modern |
| therapeutic diet in hyperlipidemic subjects with the same components taken as |
| oat, barley and psyllium for viscous fibers, soy and almonds for vegetable proteins |
| and plant sterol-enriched margarine produced similar reductions in LDL-cholesterol |
| as the Myocene-like diet and reduced the majority of subjects'' blood lipids concentrations |
| into the normal range. We conclude that reintroduction of plant food components, |
| which would have been present in large quantities in the plant based diets eaten |
| throughout most of human evolution into modern diets can correct the lipid abnormalities |
| associated with contemporary eating patterns and reduce the need for pharmacological |
| interventions.' |
| - 'passsage: Liquid dietary supplements represent a fast growing market segment, |
| including botanically-based beverages containing mangosteen, acai, and noni. These |
| products often resemble fruit juice in packaging and appearance, but may contain |
| pharmacologically active ingredients. While little is known about the human health |
| effects or safety of consuming such products, manufacturers make extensive use |
| of low-quality published research to promote their products. This report analyzes |
| the science-based marketing claims of two of the most widely consumed mangosteen |
| liquid dietary supplements, and compares them to the findings of the research |
| being cited. The reviewer found that analyzed marketing claims overstate the significance |
| of findings, and fail to disclose severe methodological weaknesses of the research |
| they cite. If this trend extends to other related products that are similarly |
| widely consumed, it may pose a public health threat by misleading consumers into |
| assuming that product safety and effectiveness are backed by rigorous scientific |
| data.' |
| - 'passsage: Dietary phytochemical compounds, including isoflavones and isothiocyanates, |
| may inhibit cancer development but have not yet been examined in prospective epidemiologic |
| studies of ovarian cancer. The authors have investigated the association between |
| consumption of these and other nutrients and ovarian cancer risk in a prospective |
| cohort study. Among 97,275 eligible women in the California Teachers Study cohort |
| who completed the baseline dietary assessment in 1995–1996, 280 women developed |
| invasive or borderline ovarian cancer by December 31, 2003. Multivariable Cox |
| proportional hazards regression, with age as the timescale, was used to estimate |
| relative risks and 95% confidence intervals; all statistical tests were two sided. |
| Intake of isoflavones was associated with lower risk of ovarian cancer. Compared |
| with the risk for women who consumed less than 1 mg of total isoflavones per day, |
| the relative risk of ovarian cancer associated with consumption of more than 3 |
| mg/day was 0.56 (95% confidence interval: 0.33, 0.96). Intake of isothiocyanates |
| or foods high in isothiocyanates was not associated with ovarian cancer risk, |
| nor was intake of macronutrients, antioxidant vitamins, or other micronutrients. |
| Although dietary consumption of isoflavones may be associated with decreased ovarian |
| cancer risk, most dietary factors are unlikely to play a major role in ovarian |
| cancer development.' |
| pipeline_tag: sentence-similarity |
| library_name: sentence-transformers |
| --- |
| |
| # SentenceTransformer based on intfloat/e5-small-v2 |
|
|
| This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [intfloat/e5-small-v2](https://huggingface.co/intfloat/e5-small-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. |
|
|
| ## Model Details |
|
|
| ### Model Description |
| - **Model Type:** Sentence Transformer |
| - **Base model:** [intfloat/e5-small-v2](https://huggingface.co/intfloat/e5-small-v2) <!-- at revision ffb93f3bd4047442299a41ebb6fa998a38507c52 --> |
| - **Maximum Sequence Length:** 512 tokens |
| - **Output Dimensionality:** 384 dimensions |
| - **Similarity Function:** Cosine Similarity |
| <!-- - **Training Dataset:** Unknown --> |
| <!-- - **Language:** Unknown --> |
| <!-- - **License:** Unknown --> |
|
|
| ### Model Sources |
|
|
| - **Documentation:** [Sentence Transformers Documentation](https://sbert.net) |
| - **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers) |
| - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) |
|
|
| ### Full Model Architecture |
|
|
| ``` |
| SentenceTransformer( |
| (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'BertModel'}) |
| (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) |
| ) |
| ``` |
|
|
| ## Usage |
|
|
| ### Direct Usage (Sentence Transformers) |
|
|
| First install the Sentence Transformers library: |
|
|
| ```bash |
| pip install -U sentence-transformers |
| ``` |
|
|
| Then you can load this model and run inference. |
| ```python |
| from sentence_transformers import SentenceTransformer |
| |
| # Download from the 🤗 Hub |
| model = SentenceTransformer("sentence_transformers_model_id") |
| # Run inference |
| sentences = [ |
| 'query: How Much Isoflavones Do I Need to Reduce Ovarian Cancer Risk?', |
| 'passsage: Dietary phytochemical compounds, including isoflavones and isothiocyanates, may inhibit cancer development but have not yet been examined in prospective epidemiologic studies of ovarian cancer. The authors have investigated the association between consumption of these and other nutrients and ovarian cancer risk in a prospective cohort study. Among 97,275 eligible women in the California Teachers Study cohort who completed the baseline dietary assessment in 1995–1996, 280 women developed invasive or borderline ovarian cancer by December 31, 2003. Multivariable Cox proportional hazards regression, with age as the timescale, was used to estimate relative risks and 95% confidence intervals; all statistical tests were two sided. Intake of isoflavones was associated with lower risk of ovarian cancer. Compared with the risk for women who consumed less than 1 mg of total isoflavones per day, the relative risk of ovarian cancer associated with consumption of more than 3 mg/day was 0.56 (95% confidence interval: 0.33, 0.96). Intake of isothiocyanates or foods high in isothiocyanates was not associated with ovarian cancer risk, nor was intake of macronutrients, antioxidant vitamins, or other micronutrients. Although dietary consumption of isoflavones may be associated with decreased ovarian cancer risk, most dietary factors are unlikely to play a major role in ovarian cancer development.', |
| "passsage: It is likely that plant food consumption throughout much of human evolution shaped the dietary requirements of contemporary humans. Diets would have been high in dietary fiber, vegetable protein, plant sterols and associated phytochemicals, and low in saturated and trans-fatty acids and other substrates for cholesterol biosynthesis. To meet the body's needs for cholesterol, we believe genetic differences and polymorphisms were conserved by evolution, which tended to raise serum cholesterol levels. As a result modern man, with a radically different diet and lifestyle, especially in middle age, is now recommended to take medications to lower cholesterol and reduce the risk of cardiovascular disease. Experimental introduction of high intakes of viscous fibers, vegetable proteins and plant sterols in the form of a possible Myocene diet of leafy vegetables, fruit and nuts, lowered serum LDL-cholesterol in healthy volunteers by over 30%, equivalent to first generation statins, the standard cholesterol-lowering medications. Furthermore, supplementation of a modern therapeutic diet in hyperlipidemic subjects with the same components taken as oat, barley and psyllium for viscous fibers, soy and almonds for vegetable proteins and plant sterol-enriched margarine produced similar reductions in LDL-cholesterol as the Myocene-like diet and reduced the majority of subjects' blood lipids concentrations into the normal range. We conclude that reintroduction of plant food components, which would have been present in large quantities in the plant based diets eaten throughout most of human evolution into modern diets can correct the lipid abnormalities associated with contemporary eating patterns and reduce the need for pharmacological interventions.", |
| ] |
| embeddings = model.encode(sentences) |
| print(embeddings.shape) |
| # [3, 384] |
| |
| # Get the similarity scores for the embeddings |
| similarities = model.similarity(embeddings, embeddings) |
| print(similarities) |
| # tensor([[ 1.0000, 0.8492, 0.0442], |
| # [ 0.8492, 1.0000, -0.0126], |
| # [ 0.0442, -0.0126, 1.0000]]) |
| ``` |
|
|
| <!-- |
| ### Direct Usage (Transformers) |
|
|
| <details><summary>Click to see the direct usage in Transformers</summary> |
|
|
| </details> |
| --> |
|
|
| <!-- |
| ### Downstream Usage (Sentence Transformers) |
|
|
| You can finetune this model on your own dataset. |
|
|
| <details><summary>Click to expand</summary> |
|
|
| </details> |
| --> |
|
|
| <!-- |
| ### Out-of-Scope Use |
|
|
| *List how the model may foreseeably be misused and address what users ought not to do with the model.* |
| --> |
|
|
| <!-- |
| ## Bias, Risks and Limitations |
|
|
| *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.* |
| --> |
|
|
| <!-- |
| ### Recommendations |
|
|
| *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.* |
| --> |
|
|
| ## Training Details |
|
|
| ### Training Dataset |
|
|
| #### Unnamed Dataset |
|
|
| * Size: 26,136 training samples |
| * Columns: <code>anchor</code> and <code>positive</code> |
| * Approximate statistics based on the first 1000 samples: |
| | | anchor | positive | |
| |:--------|:---------------------------------------------------------------------------------|:------------------------------------------------------------------------------------| |
| | type | string | string | |
| | details | <ul><li>min: 7 tokens</li><li>mean: 12.9 tokens</li><li>max: 27 tokens</li></ul> | <ul><li>min: 25 tokens</li><li>mean: 331.4 tokens</li><li>max: 512 tokens</li></ul> | |
| * Samples: |
| | anchor | positive | |
| |:------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |
| | <code>query: Does Turmeric Help With Ulcers?</code> | <code>passsage: The purpose of this review is to summarize the pertinent literature published in the present era regarding the antiulcerogenic property of curcumin against the pathological changes in response to ulcer effectors (Helicobacter pylori infection, chronic ingestion of non-steroidal anti-inflammatory drugs, and exogenous substances). The gastrointestinal problems caused by different etiologies was observed to be associated with the alterations of various physiologic parameters such as reactive oxygen species, nitric oxide synthase, lipid peroxidation, and secretion of excessive gastric acid. Gastrointestinal ulcer results probably due to imbalance between the aggressive and the defensive factors. In 80% of the cases, gastric ulcer is caused primarily due to the use of non-steroidal anti-inflammatory category of drug, 10% by H. pylori, and about 8-10% by the intake of very spicy and fast food. Although a number of antiulcer drugs and cytoprotectants are available, all these drugs h...</code> | |
| | <code>query: What Are the Dangers of Environmental Toxins for Men's Reproductive Health?</code> | <code>passsage: Male reproductive disorders that are of interest from an environmental point of view include sexual dysfunction, infertility, cryptorchidism, hypospadias and testicular cancer. Several reports suggest declining sperm counts and increase of these reproductive disorders in some areas during some time periods past 50 years. Except for testicular cancer this evidence is circumstantial and needs cautious interpretation. However, the male germ line is one of the most sensitive tissues to the damaging effects of ionizing radiation, radiant heat and a number of known toxicants. So far occupational hazards are the best documented risk factors for impaired male reproductive function and include physical exposures (radiant heat, ionizing radiation, high frequency electromagnetic radiation), chemical exposures (some solvents as carbon disulfide and ethylene glycol ethers, some pesticides as dibromochloropropane, ethylendibromide and DDT/DDE, some heavy metals as inorganic lead and mercur...</code> | |
| | <code>query: Does Flaxseed Help Lower Blood Pressure?</code> | <code>passsage: Flaxseed contains ω-3 fatty acids, lignans, and fiber that together may provide benefits to patients with cardiovascular disease. Animal work identified that patients with peripheral artery disease may particularly benefit from dietary supplementation with flaxseed. Hypertension is commonly associated with peripheral artery disease. The purpose of the study was to examine the effects of daily ingestion of flaxseed on systolic (SBP) and diastolic blood pressure (DBP) in peripheral artery disease patients. In this prospective, double-blinded, placebo-controlled, randomized trial, patients (110 in total) ingested a variety of foods that contained 30 g of milled flaxseed or placebo each day over 6 months. Plasma levels of the ω-3 fatty acid α-linolenic acid and enterolignans increased 2- to 50-fold in the flaxseed-fed group but did not increase significantly in the placebo group. Patient body weights were not significantly different between the 2 groups at any time. SBP was ≈ 10 ...</code> | |
| * Loss: [<code>CachedMultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cachedmultiplenegativesrankingloss) with these parameters: |
| ```json |
| { |
| "scale": 20.0, |
| "similarity_fct": "cos_sim", |
| "mini_batch_size": 16, |
| "gather_across_devices": false |
| } |
| ``` |
|
|
| ### Evaluation Dataset |
|
|
| #### Unnamed Dataset |
|
|
| * Size: 2,904 evaluation samples |
| * Columns: <code>anchor</code> and <code>positive</code> |
| * Approximate statistics based on the first 1000 samples: |
| | | anchor | positive | |
| |:--------|:----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------| |
| | type | string | string | |
| | details | <ul><li>min: 7 tokens</li><li>mean: 13.08 tokens</li><li>max: 27 tokens</li></ul> | <ul><li>min: 23 tokens</li><li>mean: 335.36 tokens</li><li>max: 512 tokens</li></ul> | |
| * Samples: |
| | anchor | positive | |
| |:-------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |
| | <code>query: Does Diet Reduce Alzheimer's Risk?</code> | <code>passsage: BACKGROUND: Numerous studies have investigated risk factors for Alzheimer disease (AD). However, at a recent National Institutes of Health State-of-the-Science Conference, an independent panel found insufficient evidence to support the association of any modifiable factor with risk of cognitive decline or AD. OBJECTIVE: To present key findings for selected factors and AD risk that led the panel to their conclusion. DATA SOURCES: An evidence report was commissioned by the Agency for Healthcare Research and Quality. It included English-language publications in MEDLINE and the Cochrane Database of Systematic Reviews from 1984 through October 27, 2009. Expert presentations and public discussions were considered. STUDY SELECTION: Study inclusion criteria for the evidence report were participants aged 50 years and older from general populations in developed countries; minimum sample sizes of 300 for cohort studies and 50 for randomized controlled trials; at least 2 years between ex...</code> | |
| | <code>query: Is Spam Bad For Your Diabetes?</code> | <code>passsage: Background: Fifty percent of American Indians (AIs) develop diabetes by age 55 y. Whether processed meat is associated with the risk of diabetes in AIs, a rural population with a high intake of processed meat (eg, canned meats in general, referred to as “spam”) and a high rate of diabetes, is unknown. Objective: We examined the associations of usual intake of processed meat with incident diabetes in AIs. Design: This prospective cohort study included AI participants from the Strong Heart Family Study who were free of diabetes and cardiovascular disease at baseline and who participated in a 5-y follow-up examination (n = 2001). Dietary intake was ascertained by using a Block food-frequency questionnaire at baseline. Incident diabetes was defined on the basis of 2003 American Diabetes Association criteria. Generalized estimating equations were used to examine the associations of dietary intake with incident diabetes. Results: We identified 243 incident cases of diabetes. In a c...</code> | |
| | <code>query: Is Vitamin D Good For Cancer Prevention?</code> | <code>passsage: Observational and ecological studies are generally used to determine the presence of effect of cancer risk-modifying factors. Researchers generally agree that environmental factors such as smoking, alcohol consumption, poor diet, lack of physical activity, and low serum 25-hdyroxyvitamin D levels are important cancer risk factors. This ecological study used age-adjusted incidence rates for 21 cancers for 157 countries (87 with high-quality data) in 2008 with respect to dietary supply and other factors, including per capita gross domestic product, life expectancy, lung cancer incidence rate (an index for smoking), and latitude (an index for solar ultraviolet-B doses). The factors found to correlate strongly with multiple types of cancer were lung cancer (direct correlation with 12 types of cancer), energy derived from animal products (direct correlation with 12 types of cancer, inverse with two), latitude (direct correlation with six types, inverse correlation with three), and...</code> | |
| * Loss: [<code>CachedMultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cachedmultiplenegativesrankingloss) with these parameters: |
| ```json |
| { |
| "scale": 20.0, |
| "similarity_fct": "cos_sim", |
| "mini_batch_size": 16, |
| "gather_across_devices": false |
| } |
| ``` |
|
|
| ### Training Hyperparameters |
| #### Non-Default Hyperparameters |
|
|
| - `eval_strategy`: epoch |
| - `per_device_train_batch_size`: 128 |
| - `learning_rate`: 2e-05 |
| - `num_train_epochs`: 30 |
| - `warmup_ratio`: 0.1 |
| - `fp16`: True |
| - `load_best_model_at_end`: True |
| - `batch_sampler`: no_duplicates |
| |
| #### All Hyperparameters |
| <details><summary>Click to expand</summary> |
| |
| - `overwrite_output_dir`: False |
| - `do_predict`: False |
| - `eval_strategy`: epoch |
| - `prediction_loss_only`: True |
| - `per_device_train_batch_size`: 128 |
| - `per_device_eval_batch_size`: 8 |
| - `per_gpu_train_batch_size`: None |
| - `per_gpu_eval_batch_size`: None |
| - `gradient_accumulation_steps`: 1 |
| - `eval_accumulation_steps`: None |
| - `torch_empty_cache_steps`: None |
| - `learning_rate`: 2e-05 |
| - `weight_decay`: 0.0 |
| - `adam_beta1`: 0.9 |
| - `adam_beta2`: 0.999 |
| - `adam_epsilon`: 1e-08 |
| - `max_grad_norm`: 1.0 |
| - `num_train_epochs`: 30 |
| - `max_steps`: -1 |
| - `lr_scheduler_type`: linear |
| - `lr_scheduler_kwargs`: {} |
| - `warmup_ratio`: 0.1 |
| - `warmup_steps`: 0 |
| - `log_level`: passive |
| - `log_level_replica`: warning |
| - `log_on_each_node`: True |
| - `logging_nan_inf_filter`: True |
| - `save_safetensors`: True |
| - `save_on_each_node`: False |
| - `save_only_model`: False |
| - `restore_callback_states_from_checkpoint`: False |
| - `no_cuda`: False |
| - `use_cpu`: False |
| - `use_mps_device`: False |
| - `seed`: 42 |
| - `data_seed`: None |
| - `jit_mode_eval`: False |
| - `bf16`: False |
| - `fp16`: True |
| - `fp16_opt_level`: O1 |
| - `half_precision_backend`: auto |
| - `bf16_full_eval`: False |
| - `fp16_full_eval`: False |
| - `tf32`: None |
| - `local_rank`: 0 |
| - `ddp_backend`: None |
| - `tpu_num_cores`: None |
| - `tpu_metrics_debug`: False |
| - `debug`: [] |
| - `dataloader_drop_last`: False |
| - `dataloader_num_workers`: 0 |
| - `dataloader_prefetch_factor`: None |
| - `past_index`: -1 |
| - `disable_tqdm`: False |
| - `remove_unused_columns`: True |
| - `label_names`: None |
| - `load_best_model_at_end`: True |
| - `ignore_data_skip`: False |
| - `fsdp`: [] |
| - `fsdp_min_num_params`: 0 |
| - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False} |
| - `fsdp_transformer_layer_cls_to_wrap`: None |
| - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} |
| - `parallelism_config`: None |
| - `deepspeed`: None |
| - `label_smoothing_factor`: 0.0 |
| - `optim`: adamw_torch_fused |
| - `optim_args`: None |
| - `adafactor`: False |
| - `group_by_length`: False |
| - `length_column_name`: length |
| - `project`: huggingface |
| - `trackio_space_id`: trackio |
| - `ddp_find_unused_parameters`: None |
| - `ddp_bucket_cap_mb`: None |
| - `ddp_broadcast_buffers`: False |
| - `dataloader_pin_memory`: True |
| - `dataloader_persistent_workers`: False |
| - `skip_memory_metrics`: True |
| - `use_legacy_prediction_loop`: False |
| - `push_to_hub`: False |
| - `resume_from_checkpoint`: None |
| - `hub_model_id`: None |
| - `hub_strategy`: every_save |
| - `hub_private_repo`: None |
| - `hub_always_push`: False |
| - `hub_revision`: None |
| - `gradient_checkpointing`: False |
| - `gradient_checkpointing_kwargs`: None |
| - `include_inputs_for_metrics`: False |
| - `include_for_metrics`: [] |
| - `eval_do_concat_batches`: True |
| - `fp16_backend`: auto |
| - `push_to_hub_model_id`: None |
| - `push_to_hub_organization`: None |
| - `mp_parameters`: |
| - `auto_find_batch_size`: False |
| - `full_determinism`: False |
| - `torchdynamo`: None |
| - `ray_scope`: last |
| - `ddp_timeout`: 1800 |
| - `torch_compile`: False |
| - `torch_compile_backend`: None |
| - `torch_compile_mode`: None |
| - `include_tokens_per_second`: False |
| - `include_num_input_tokens_seen`: no |
| - `neftune_noise_alpha`: None |
| - `optim_target_modules`: None |
| - `batch_eval_metrics`: False |
| - `eval_on_start`: False |
| - `use_liger_kernel`: False |
| - `liger_kernel_config`: None |
| - `eval_use_gather_object`: False |
| - `average_tokens_across_devices`: True |
| - `prompts`: None |
| - `batch_sampler`: no_duplicates |
| - `multi_dataset_batch_sampler`: proportional |
| - `router_mapping`: {} |
| - `learning_rate_mapping`: {} |
|
|
| </details> |
|
|
| ### Training Logs |
| | Epoch | Step | Training Loss | Validation Loss | |
| |:--------:|:--------:|:-------------:|:---------------:| |
| | 1.0 | 205 | 1.4561 | 0.0201 | |
| | 2.0 | 410 | 0.1947 | 0.0127 | |
| | 3.0 | 615 | 0.1403 | 0.0114 | |
| | 4.0 | 820 | 0.1137 | 0.0088 | |
| | 5.0 | 1025 | 0.0911 | 0.0080 | |
| | 6.0 | 1230 | 0.0818 | 0.0084 | |
| | 7.0 | 1435 | 0.0734 | 0.0078 | |
| | 8.0 | 1640 | 0.067 | 0.0076 | |
| | 9.0 | 1845 | 0.0607 | 0.0082 | |
| | 10.0 | 2050 | 0.0553 | 0.0073 | |
| | 11.0 | 2255 | 0.0526 | 0.0065 | |
| | 12.0 | 2460 | 0.0505 | 0.0066 | |
| | 13.0 | 2665 | 0.0505 | 0.0063 | |
| | 14.0 | 2870 | 0.0466 | 0.0060 | |
| | 15.0 | 3075 | 0.0448 | 0.0063 | |
| | 16.0 | 3280 | 0.045 | 0.0060 | |
| | 17.0 | 3485 | 0.0417 | 0.0057 | |
| | 18.0 | 3690 | 0.0395 | 0.0057 | |
| | 19.0 | 3895 | 0.0425 | 0.0065 | |
| | 20.0 | 4100 | 0.0379 | 0.0058 | |
| | 21.0 | 4305 | 0.0389 | 0.0055 | |
| | 22.0 | 4510 | 0.0394 | 0.0055 | |
| | 23.0 | 4715 | 0.0351 | 0.0057 | |
| | 24.0 | 4920 | 0.0359 | 0.0054 | |
| | **25.0** | **5125** | **0.0366** | **0.0054** | |
| | 26.0 | 5330 | 0.0356 | 0.0055 | |
| | 27.0 | 5535 | 0.0347 | 0.0055 | |
| | 28.0 | 5740 | 0.0346 | 0.0054 | |
|
|
| * The bold row denotes the saved checkpoint. |
|
|
| ### Framework Versions |
| - Python: 3.12.12 |
| - Sentence Transformers: 5.1.2 |
| - Transformers: 4.57.1 |
| - PyTorch: 2.8.0+cu126 |
| - Accelerate: 1.11.0 |
| - Datasets: 4.0.0 |
| - Tokenizers: 0.22.1 |
|
|
| ## Citation |
|
|
| ### BibTeX |
|
|
| #### Sentence Transformers |
| ```bibtex |
| @inproceedings{reimers-2019-sentence-bert, |
| title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", |
| author = "Reimers, Nils and Gurevych, Iryna", |
| booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", |
| month = "11", |
| year = "2019", |
| publisher = "Association for Computational Linguistics", |
| url = "https://arxiv.org/abs/1908.10084", |
| } |
| ``` |
|
|
| #### CachedMultipleNegativesRankingLoss |
| ```bibtex |
| @misc{gao2021scaling, |
| title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup}, |
| author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan}, |
| year={2021}, |
| eprint={2101.06983}, |
| archivePrefix={arXiv}, |
| primaryClass={cs.LG} |
| } |
| ``` |
|
|
| <!-- |
| ## Glossary |
|
|
| *Clearly define terms in order to be accessible across audiences.* |
| --> |
|
|
| <!-- |
| ## Model Card Authors |
|
|
| *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.* |
| --> |
|
|
| <!-- |
| ## Model Card Contact |
|
|
| *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.* |
| --> |
