votanthanh32004/bge-m3-finetuned

SentenceTransformer based on BAAI/bge-m3

This is a sentence-transformers model finetuned from BAAI/bge-m3. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-m3
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'PeftModelForFeatureExtraction'})
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Want to learn more about this role and Jobot? Click our Jobot logo and follow our Linked In page! Job details Staff Accountant, Bookkeeper for Architectural Firm $60 k-$80 k Great Place To Work! This Jobot Job is hosted by Mike Basile Are you a fit? Easy Apply now by clicking the "Easy Apply" button and sending us your resume. Salary $60,000 - $80,000 per year A Bit About Us We are a small Architectural firm that focuses on academic, civic and religious institutions, U.S. government agencies, and foreign embassies. Why join us? Strong Compensation, Benefits, Great Culture Job Details Requirements 1 to 5 years of proven accounting and administrative experience Proficient in WORD and Excel and accounting software. Experience Unanet AE software a plus Business Manager with 2- 6 years of accounting and administrative experience Ability to direct & oversee all financial & tax activities of the firm including accounts payable, accounts receivable, billing, payroll, general accounting Responsibilities Day-to-day bookkeeping including accounts receivable, accounts payable, processing checks, preparing bank deposits, bank reconciliations, and preparing financial reports using UNANET AE accounting software Analyzing accounting information and preparing cash flow, profitability and other reports to present to Partners in regular monthly meetings Performing HR-related matters such as timesheets management, processing payroll (ADP), maintaining employee files, tracking leave, and managing benefits including health insurance, life and disability insurance, 401-K Assist outside CPA with the information needed for income tax filings and or audits Interested in hearing more? Easy Apply now by clicking the "Easy Apply" button. Want to learn more about this role and Jobot? Click our Jobot logo and follow our Linked In page!',
    "Professional Summary Accountant with more than 8 years accounting experience with profit making ,non for profit and non-governmental organizations (NGOs). Possess solid principles knowledge of GAAP, GASB and IFRS. Proficient in automated systems: such as Quick Books, Sun system and Peachtree Accounting. Core Qualifications General Ledger Accounting Balance sheet account reconciliation Bank & Office Account reconciliation Financial data analysis Financial Statements & Audit Support Generate various reports Adjusting entries and periodic closing Review and monitoring of accounting event Financial Planning, Budgeting & Reporting Grants Management Contractual agreement and modification Donor reporting Monitor and manage sub-grantee Fund release for subs System improvement and recommendations External/Internal reporting Project closing Accounting Systems:Sage Accounting, Quick Books, Sun system , Peachtree Accounting and Mo.s.t Presentation Software: Microsoft Power Point.Spreadsheets: Advanced Excel with pivot tables, Lookups, references and Consolidation.Database: Microsoft Access.Email: Outlook and Lotus note Experience 02/2015 to Accountant Saint Louis,MO,Responsible for account coding accuracy Record, and reconcile Accounts Payables on a monthly basis Review and reconcile on-line corporate credit card transactions and documentation Actively participate in improvement of procedures and processes Review and report excess and obsolete inventory Prepare the invoices state and federal grant funders for reimbursable expenditures Prepare the invoices state and federal grant funders for reimbursable expenditures prepare 35 companies Bank reconciliation Accuracy of FIM tables (Financial Integration Module) Assist with preparation of budgets Provide status of financial condition by collecting, interpreting, and reporting financial data Prepare special reports by collecting, analyzing and summarizing Review all variances / exceptions, explain and resolve Responsible for assisting with weekly / monthly / yearly closing activity Responsible for Journal Entries and General Ledger analysis Prepare internal reports regarding production, capacity and efficiencies Accounts payable and accounts receivable functions as directed Credit Card reconciliation All department processes and procedures documented and the appropriate individual(s) trained and cross-trained as necessary.01/2010 to 08/2014 Delegated Finance and Admin Manager and Finance Officer Anova ,,Ethiopia Prepared standardize monthly, quarterly, biannual and annual finances and review overall financial reports and follow up financial status & Over viewed Organization Finance and Administration as a delegate.Documented the process by which NGOs are selected for awards and notify applicants and other stakeholders of awards granted where open solicitations are sought Identified and assisted grantees in developing work plans, monitoring progress, tracking expenses, preparing reports, and facilitating grantees' compliance with the terms of their agreements Conducted field visits to monitor grantees and provide on-site support with respect to financial grant management Collaborated with program staff to assist in developing and revising mechanisms for making payments and monitoring and reporting financial performance of sub-grantees Reviewed several grantee monthly financial reports, including invoices, budgets and up keeping databases Led a team through the entire process for sub grantees selection, from pre-award assessment to project closing Facilitated the processing of modification of sub-agreements, maintain and update grants & contract document Followed-up contribution and recording of identified cost share expenses with sub-grantees Contributed to the development of grants management manual, materials, and resources Controlling and processing of Account Receivable , payable and Reconciling of account Ensured adherence to the organization's global financial policy, domestic financial procedures and guidelines related to disbursement activities, general accounts and grants Engaged in maintaining monthly and annual fixed asset inventory registration Ensured document tracking- paid stamp and filling are done in tact Ensured that financial transactions are recorded as per the chart of accounts and with proper source documents Reviewed and ensure the accuracy and quality of financial statements prepared Managed grant projects and fund release from donors & control budget utilization Ensured that all financial documents and reports are well documented & safely placed Facilitated internal and external audits and led development of action plans based on audit recommendations and monitored progress Led, supervised, guided and supported staff members, including accountant, cashier and storekeeper Participated in proposal budgeting when new projects are initiated.10/2008 to 12/2009 Senior Accountant Expedia ,,Ethiopia Produced periodic financial reports for both internal (organization) and external use (donors & government) and interpret and analyze the reports and actual results against budgets and recommend program management team and budget holders Ensured that financial transactions are recorded as per chart of accounts & with proper source documents Reviewed and initiated approval for disbursements including contracts and sub contacts payment Managed grant projects and fund release from donors & control budget utilization Ensured that procurements are made per the organization procurement policy and Donor requirement Ensured that fixed assets registration and facilitated the annual inventory count Ensured bank reconciliation is made timely Reviewed payroll and ensure that government taxes are paid regularly and timely Controlled staff benefits like; insurance, medical, PF etc.02/2007 to 09/2008 Accountant Anova ,,Ethiopia Ensured that financial transactions are recorded as per the chart of accounts and with proper source documents Followed up annual budget/cash flow Controlled the timely disbursement and settlement of different expenses Ensured that procurements are made as per procurement protocols Prepared checks and initiate bank reconciliation Prepared payroll and prepared income and other government tax payment Controlled petty cash and availability of cash on hand for daily activity Record financial transactions per World Vision chart of accounts & document them Record grant projects financial activities; expense settlement & produce grant financial report Record fixed Assets per World Vision policies and facilitate annual inventory of project inventories Make ready financial documents for internal & external audit. Education Expected intoto MBA Degree Business Administration,,GPA:Foundation for Academic Excellence, Ethiopia Completed 29 credits Business Administration Expected intoto B.A Accounting Haramaya University,,GPA:Accounting Skills Academic, Account reconciliation, Accounting, accountant, Accounting Systems, Accounts payable, Accounts Payables, accounts receivable, Balance sheet, Bank reconciliation, benefits, Budgeting, budgets, budget, cash flow, cashier, closing, contracts, Credit, data analysis, databases, Database, documentation, Email, external audits, filling, Finance, Financial, Financial Planning, financial report, financial reports, Financial Statements, fixed Assets, General Ledger, General Ledger Accounting, government, Grants, Information Technology, insurance, inventory, Lotus, materials, Microsoft Access, Excel, Office, Outlook, Microsoft Power Point, payroll, Peachtree Accounting, pivot tables, policies, processes, procurement, program management, coding, progress, proposal, protocols, quality, Quick Books, Reconciling, recording, reporting, requirement, Sage, Spreadsheets, Sun, tables, tax, taxes, Vision",
    "Summary Highly talented and accomplished professional with extensive skills and experience in complex work environments. Coordination, planning and support of daily operational and administrative functions Detail-oriented and well organized when completing projects; able to multi-task effectively Experienced working in fast paced environments demanding strong organizational, technical and interpersonal skills. Skills Microsoft Word, Excel, Publisher, Power Point, Outlook, Lawson, Time Matters and Internet. Experience Data Analyst,07/2012-Present Lewis Pr–New York,NY,Collect and compile data for state/federal requirements which includes audit documentation regarding professional learning activities.Assist the Title II Department with the allocation, management and tracking of Title II, Part A program funds.Maintains and develops electronic files, records for easy access of reports.Prepare spend down reports for various departments that use Title II funds.Enter requisitions for activities allowable under Title IIA.Provides on-going technical support to public/private school and other district personnel including conducting meetings regarding compliance.Compiles and summarizes program data for all required Federal and State reports.Assist with the preparation of documents for meetings involving stake holders.Assist in preparation of presentations and meetings.Assist with procurement process of compliance with documentation.Conduct surveys with personnel and stakeholders to assess the needs of the district and compile data for reports.Works closely with various departments to track expenditures and gather information necessary as requested by Title II Department.Data Analyst,06/2012-11/2012 Lewis Pr–Chicago,IL,Compiled and evaluated student data for the purpose of assessing program effectiveness, student growth and provider quality including completion of federal and state reports.Assisted with the development of district policies and procedures for effectively implementing, monitoring and evaluating the Title I Supplemental Educational Service program in accordance with federal law.Evaluated and processed vendor invoices against student attendance reports and performance data to ensure reliability and validity.Assisted with preparation, processing and review of contractual agreements for all vendors as well as enter contract information in Lawson system.Developed and created marketing programs to effectively communicate with parents, district personnel and the community regarding the SES program services.Facilitated training and workshops for school/district personnel, parents, vendors and community members regarding Title I program guidelines.Monitored school sites where tutorials take place to ensure that providers are in compliance with guidelines set forth.Administrative Assistant,09/2009-11/2012 Primrose School–Oldsmar,FL,Provided administrative support for the Supplemental Educational Services Program including acting as a liaison between the tutorial providers, school personnel and parents, adhering to and interpreting state and federal program guidelines and relaying that information to the public, and meeting deadlines for reports.Prepared spreadsheets and data reports summarizing enrollment data by school/provider.Monitored school sites where tutorials take place to ensure that providers are in compliance with guidelines set forth.Prepared correspondence, create email distribution lists, maintain calendars, organize mass mailings and file management.Maintained and track database of over 2,400 students.Verified free/reduced lunch status of students requesting to participate in the program.Assisted with completion of all state reports/surveys regarding SES.Provided executive-level administrative support to the Program Director of Title I Office with a demonstrated ability to improvise, improve procedures, and meet demanding deadlines.Collaborated and met with other departments to complete special projects including summer school.Conducted surveys regarding summer school and compile data for reports.Legal Assistant,04/2002-12/2008 State Of Ohio–Wayne County,OH,Provided administrative support to Managing Partner and Associates in general practice law firm with a demonstrated ability to improvise, improve procedures and meet demanding deadlines.Acted as a liaison between clients and attorneys, arranged meetings, maintained calendars, drafted correspondence, maintained and organized files, sent documents by facsimile, photocopied, proofread, prepared memos, sent documents by overnight mail, scanned documents, and downloaded documents.Managed client files (opening and closing files, maintaining client databases and attorney billing).Prepared and interpreted legal documents, such as but not limited to Contracts of Sale, Promissory Notes, and Powers of Attorney.Assisted accounting department in maintaining bank accounts, including managing sub-accounts for clients, writing checks and communicating with the bank regarding deposits and wire transfers.Supervised and trained part-time and summer employees, including, delegating responsibilities, overseeing and reviewing tasks completed and collecting time sheets.Provided support to the office manager in handling payroll and accounts payable/receivable responsibilities.Assisted with firm marketing, including preparation of packets for presentations, building and fostering working relationships with affiliated companies to increase clientele. Education and Training Juris Doctor:,Expected in May-ATLANTA'S JOHN MARSHALL LAW SCHOOL-,GPA:Status-B.S:Business Administration,Expected in May 2001-CHEYNEY UNIVERSITY OF PENNSYLVANIA-,GPA:Status-magna cum laude Business Administration Skillsaccounting, accounts payable, administrative support, Attorney, billing, closing, Computer experience, Contracts, clientele, client, clients, databases, database, documentation, email, facsimile, file management, forth, funds, IIA, Lawson, law, legal documents, Notes, Director, Managing, marketing, meetings, access, Excel, mail, Office, Outlook, Power Point, Publisher, Microsoft Word, Works, office manager, payroll, personnel, policies, presentations, procurement, quality, spreadsheets, surveys, technical support, workshops",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.9033, 0.7620],
#         [0.9033, 1.0000, 0.7852],
#         [0.7620, 0.7852, 1.0000]])

Training Details

Training Dataset

Unnamed Dataset

• Size: 8,000 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 19 tokens mean: 244.95 tokens max: 256 tokens	min: 225 tokens mean: 255.94 tokens max: 256 tokens	min: 225 tokens mean: 255.94 tokens max: 256 tokens

• Samples:

  anchor	positive	negative
  Data Engineer Level 3 6 Months Contract to Hire Database developer to develop and support cloud DB systems. Proficiency in the maintenance and administration https:kroger.talentnow.aicandidates?query not Placedof distributed databases on microsoft azure, like microsoft azure postgresql, microsoft azure Cosmos. Experience in disaster recovery planning and conduct disaster recovery testing Collaborate with development teams to design and optimize database schemas, indexes, and data models, monitor and tune SQL Queries, identify bottlenecks, and optimize query execution plans. What will the resource be working on? The Enterprise Customer team is building a new customer platform (APIs, microservices) to consolidate multiple customer systems into a single source of truth for customer data in the enterprise. Multiple new subsystems need to be built as well as enhanced existing ones already built. The systems are built cloud-native in microsoft azure using go, nosql databases, and Kafka.	Profile Highly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market. Core Qualifications Windows NT/2000/XP/Vista Windows 95/98 Windows Server 2003/2008 MS DOSLinux OS XDatabases sql server Server,MY SQLPostgre SQLSQLite MS Access Programming languages C/C++(STL, BOOST, QT, OSG, Open computer vision)/Visual C++Objective CVB 6 VB.NET, VB for Applications Classic ASPC#(asp.net, asp.net model view controller, Win Forms, WPF)PHPProvide XJava Script , HTML 5, CSS, AJAXMaya Embedded Language (MEL)Mobilei OSAndroid Professional Experience Software Developer,08/2014 to 01/2017–,,Development and implementation of Ricky's Deal e-Commerce web application.Developed back-end code by asp.net model view controller (C#).Developed custom design patterns.Developed client side pages by HTML, CSS, j Query, Angular javascript.Desig...	Summary Experienced, dedicated and focused Data Analyst and Administrative Assistant with 10+ years of analyzing data who excels at prioritizing, completing multiple tasks simultaneously and following through to achieve project goals. Seeking a role of increased responsibility and opportunities. Highlights Aspen X 2 (Special Education Database Software)e SPED (Special Education Database Software)Yardi Property Management (Real Estate Database Software)Proficient in Microsoft Word,Excel,Power Point, Access, Publisher Quick Books ACTInternet Research Social Media Results-oriented Self-directed Effective Trainer Time management Professional and mature Strong problem solver Dedicated team player Strong interpersonal skills Report development Self-starter Meticulous attention to detail Experience 2014 to Current Special Education Administrative Assistant/Data Analyst Air Communities–Philadelphia,PA,Special Education Software Management (Aspen X 2) troubleshooting for Special Education Staff...
  Title: Senior Accountant II Duration: 12 months (Long Term Contract, Potential Extension up to 36 months)Location: Onsite - Miami, FL - 1080 Caribbean Way Shift: Our normal business hours are 9 am - 6 project manager M-F. All candidates must be available to work those hours. Some weekend and overtime work may be required. ESSENTIAL DUTIES AND RESPONSIBILITIES: Manages and coordinates responsibilities of several staff to ensure adherence to Sarbanes Oxley internal controls, procedural accounting policies and achievement of departmental goals. Applies Generally Accepted Accounting Principles to determine accurate accounting. Understands the impact of exchange rates, tax implications and country specific requirements of each country where incorporated. Identify areas of potential internal control issues and function as liaison with Audit and Advisory Services and the companys independent auditors for the timely resolution of any such issues. Assists management in the analysis and identifi...	Summary Professional Accountant and Bookkeeper with 12 years of experience with accounts receivable and payable.Detail-oriented bookkeeping professional with 3+ years experience applying financial and managerial accounting practices. Skills SAP, Great Plains Dynamics, Sage 50, Quick Books Pro, ACT, Microsoft Word, Excel (Pivot tables and VLook Up) Access, Power Point Experience 09/2015 to 09/2017 Staff Accountant Exp World Holdings Inc. Cherry Hill,NJ,Supported Regional Finance Manager with special projects and other responsibilities as assigned.Handled monthly accrual process for 22 expense accounts.Full responsibility for all fixed assets; maintained detailed depreciation schedules.Conducted monthly reconciliations of all balance sheet accounts to ensure their accuracy.Reconciled 4 bank accounts (250+ transactions per month), researched and resolved all issues.AP: Reviewed, processed and reconciled invoices ensuring timely payment (500+K monthly).Monthly analysis of AP process led to...	Professional Summary Energetic Data Engineer in developing robust code for high-volume businesses. Strong decision-maker with 6 years of experience in Data engineering and help firms in designing and executing solutions for complex business problems involving large scale data warehousing, real-time analytics and reporting solutions. Ability to translate business questions and concerns into specific quantitative questions that can be answered with available data using sound methodologies. Skills Python 3.x, R, SQLHadoop, Apache Spark Hive, Pig, Kafka, Sqoop, Oozie Teradata, Snowflake Amazon S 3,EMR,Lambda Git, Jenkins, Splunk MS Office Microsoft Visual C#.NET Work History Data Engineer,04/2020 to Current Avanade–Bangor,ME,Combining data from multiple source systems (Profile, Systematics, etc..) and multiple platforms (Snowflake, One Lake, Hubs) and computing canonical gold-star metrics “once and for all” to cut operational costs.Develop Spark jobs to transform data and apply business tr...
  "All candidates must be directly contracted by ASK Consulting on their payroll and cannot be subcontracted. We are unable to provide sponsorship at this moment". Job Title: Software Engineer Location: Denver, CODuration: 6 Months Contract Pay Range: $40- $45 hr. Job Description:The Software Engineer will be responsible for building mission-critical Integrations between source data with financial Saa S applications. A day in the life:Leads multidimensional projects that involve multiple teams.Leads and works with other software engineers on design best practices and conducts code reviews.Resolves complex engineering problems, collaborating with others.Facilitates cross functional troubleshooting, root cause analysis and engages others when needed.Responsible for creating, evaluating, and contributing to feature detailed designs.Design, develop, and implement software utilizing an agile project cycle.Mentor others on the team and raise the bar for technical knowledge across a wide spectr...	Professional Summary Results-oriented and innovative Senior Software Engineer with 10+ years of experience. Easily communicates complex technical requirements to non-technical stakeholders. Excellent leadership record of leading development teams in enterprise-wide development projects. Skills Programming Languages:C# (.net 4.5/4.0), Java (JDK 1.7/1.8, Java SE, JEE technologies including JDBC, Threads), WPF (MVVM methodology)Cloud Technologies:Microsoft microsoft azure, App services, SQL microsoft azure, Service Bus, Blob Storage Web Technologies:HTML, CSS, Java Script, AJAX, RESTful APIs, j Query, Angular javascript, Ember javascript, Bootstrap, JSONDatabases:Microsoft sql server, microsoft azure Cosmos DB, Oracle 11 i, My SQL, DB 2 Agile/Scrum Methodology Source and Version Control: Git Work History 12/2019 to 02/2022 Lead/Sr. Software Engineer Corptax Chicago,IL,Responsible for end-to-end project delivery with Product Architect.Communicated project plans, tracking details, status up...	Summary Involving in various projects related to Data Modeling, Data Analysis, Design and Development for Data warehousing environments. Practical understanding of the Data modeling (Dimensional & Relational) concepts like Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables. Comprehensive knowledge and experience in process improvement, normalization/de-normalization, data extraction, data cleansing, data manipulation. Exceptional troubleshooting skills with ETL Technologies. Highlights Hadoop, Hive, Avro, Kafka, Map Reduce, Looker Programming Languages: SQL, Java, Scala, PHP, Shell Script, HTML Database Tools: Aster Database, Postgre SQL, My SQL Operating Systems: Linux, Unix, Microsoft Windows Experience 08/2012 to Current Data Engineer Avanade Greenville,NC,Experience with full development cycle of a Data Warehouse, including requirements gathering, design, implementation, and maintenance.Data modeling based on Kimball methodology, developed and architected ET...

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false,
      "directions": [
          "query_to_doc"
      ],
      "partition_mode": "joint",
      "hardness_mode": null,
      "hardness_strength": 0.0
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 2
• num_train_epochs: 2
• learning_rate: 0.0002
• lr_scheduler_type: cosine
• warmup_steps: 0.15
• optim: adamw_torch
• gradient_accumulation_steps: 16
• fp16: True
• gradient_checkpointing: True
• gradient_checkpointing_kwargs: {'use_reentrant': False}

All Hyperparameters

Click to expand

• per_device_train_batch_size: 2
• num_train_epochs: 2
• max_steps: -1
• learning_rate: 0.0002
• lr_scheduler_type: cosine
• lr_scheduler_kwargs: None
• warmup_steps: 0.15
• optim: adamw_torch
• optim_args: None
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 16
• average_tokens_across_devices: True
• max_grad_norm: 1.0
• label_smoothing_factor: 0.0
• bf16: False
• fp16: True
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• gradient_checkpointing: True
• gradient_checkpointing_kwargs: {'use_reentrant': False}
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: trackio
• eval_strategy: no
• per_device_eval_batch_size: 8
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: False
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: []
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• warmup_ratio: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss
0.08	10	1.5855
0.16	20	1.5345
0.24	30	1.3936
0.32	40	1.3104
0.4	50	1.2821
0.48	60	1.1997
0.56	70	1.2337
0.64	80	1.2323
0.72	90	1.1985
0.8	100	1.1837
0.88	110	1.1681
0.96	120	1.1685
1.04	130	1.1101
1.12	140	1.1645
1.2	150	1.1763
1.28	160	1.1175
1.3600	170	1.1016
1.44	180	1.1770
1.52	190	1.1667
1.6	200	1.1452
1.6800	210	1.1645
1.76	220	1.1584
1.8400	230	1.1442
1.92	240	1.1169
2.0	250	1.1622

Framework Versions

• Python: 3.12.12
• Sentence Transformers: 5.3.0
• Transformers: 5.5.0
• PyTorch: 2.10.0+cu128
• Accelerate: 1.12.0
• Datasets: 4.8.4
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{oord2019representationlearningcontrastivepredictive,
      title={Representation Learning with Contrastive Predictive Coding},
      author={Aaron van den Oord and Yazhe Li and Oriol Vinyals},
      year={2019},
      eprint={1807.03748},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/1807.03748},
}