Fatin757's picture
Add new SentenceTransformer model
3faf90e verified
|
Raw
History Blame Contribute Delete
46.9 kB
metadata
language:
  - en
license: apache-2.0
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - generated_from_trainer
  - dataset_size:800
  - loss:TripletLoss
base_model: nomic-ai/modernbert-embed-base
widget:
  - source_sentence: >-
      The Mergers and Acquisitions Partner/Mergers and Acquisitions Director is
      a team leader in charge of various functions including generating and
      growing the business, quality control, providing technical leadership as
      well as sourcing appropriate staff for the team. He/She is given the
      signing authority for any client deliverables in a consultancy role, or
      responsibility for corporate development in-house. He/She is responsible
      for the quality of technical output, and risk management for the business.
      The Mergers and Acquisitions Partner/Mergers and Acquisitions Director is
      an expert in mergers and acquisitions and should possess considerable
      transaction experience. He has strong commercial acumen and strong
      quantitative skills. He is responsible for marketing and business
      development, client and stakeholder relationship management, and making
      decisions on engagements and client acceptance. He may work in an internal
      role within an organisation or in an advisory role in a professional
      services firm. He may also be a generalist or specialist in areas such as
      infrastructure advisory or project finance. In order to perform his duties
      effectively, he needs to stay up-to-date with current events and be
      well-connected with key executives within his sector. He maintains a
      global perspective and leverages his cross-border knowledge to help drive
      successful project outcomes. He manages multiple projects simultaneously
      and is able to lead teams effectively.
    sentences:
      - M&A Specialist
      - ' Chief Technology Officer (CTO) - Engineering Focus'
      - >-
        The Key Grip oversees the execution of camera positioning, mounting,
        movements and manoeuvres for all cameras in order to achieve the
        production requirements. He/She is responsible for supervising the
        installation of structures and equipment that will help achieve the
        special camera movements required. He also executes the camera
        positioning, mounting, movements and manoeuvres for the main camera.
        During rehearsals, he is required to monitor the camera movements and
        propose changes that will enhance the quality of the shoot. He needs to
        be creative and inventive in order to manage the mounting of equipment
        and camera for difficult shots.


        The work involves physically demanding tasks especially the handling of
        the heavy equipment used in the construction of the structures. He may
        be required to work outdoors and may be required to travel depending on
        the location of the shoot or production.


        He should possess knowledge of the camera and mounting equipment
        construction structures as well as the camera effects from the different
        construction structures. He is required to possess effective teamwork,
        be diplomatic and tactful when working with the crew to achieve the
        creative vision. He is also required to have strong people management
        capabilities in order to lead the grip team and provide additional
        coaching when required.
  - source_sentence: >-
      The Production Manager oversees all activities in the production
      department and ensures that plant operations comply with regulatory and
      organisational requirements. He/She is accountable for plant operations
      and performance, in accordance with production aims and objectives, and
      securing high operational availability so that production plans are
      executed in the most cost-effective manner.


      The Production Manager endorses risk assessments for production-related
      activities, Safe System of Work (SSoW) processes and procedures, Standard
      Operating Procedures (SOPs) and the annual production plan and schedule.
      He manages emergency responses as the Site Main Controller (SMC) of the
      organisations Emergency Response Team (ERT) and participates in crisis
      management activities according to his designated role. In addition, he
      coaches and mentors production department personnel in plant technology,
      and reviews and approves initiatives and activities for continuous
      improvements within plants.


      The Production Manager works on a day shift and oversees the production
      department in the field and/or control room. As a department manager, he
      is required to have good leadership, resource management, planning,
      analytical and problem-solving skills, and must be able to interact
      effectively with others to achieve departmental goals.
    sentences:
      - >-
        The Operations Integration Specialist/System Integration
        Engineer/Infrastructure Specialist is responsible for development or
        project management of complex logistics IT systems. He/She is also
        responsible for assessing and integrating IT applications, networks and
        infrastructure solutions with logistics business operation needs. 


        Analytical and systematic, he is required to manage complex IT projects
        and analyse system and infrastructure integration plans. He is also
        expected to coordinate closely with internal and external stakeholders
        to implement IT systems.
      - Factory Operations Manager
      - Director of Product Origination
  - source_sentence: >-
      The Business Development Manager is responsible for managing business
      development strategy implementation. He/she implements market expansion
      and new market plans for business growth. By engaging key internal
      stakeholders, he supports cross-functional collaboration for business
      development activities. He also performs data analysis on partnerships,
      Joint Ventures (JV) and Mergers and Acquisitions (M&A) to expand the
      market share of the organisation. 


      Independent and insightful, he possesses strong business acumen and is
      able to source for growth opportunities. He supports the proactive pursuit
      of growth opportunities by being aware of market trends, industry events,
      competitors' actions and clients' needs. He is also able to adapt
      strategies and plans to ensure success in a competitive and global
      market. 


      He travels frequently, maintains rapport with potential and existing
      clients, and networks extensively outside of the office to develop
      business relationships.
    sentences:
      - Intellectual Property Process Coordinator
      - Strategic Partnerships Manager
      - >-
        The Channel Sales Manager utilises strategies and tactics to win,
        maintain and expand relationships with channel partners. He/She works
        toward achieving sales, profitability, and channel partner recruitment
        objectives. He may represent selected number or the entire range of
        organisation products; develops and implements unique partner joint
        solutions that deliver a compelling value for target customers. He
        trains and educates channel sales partners about product and service
        offerings and features. He assesses, clarifies, and validates partner
        needs on an ongoing basis to ensure compliance with partner agreements
        and goals. He works in a fast-paced and dynamic environment that
        requires visits to channel partner sales premises. He is familiar with
        client relationship management and sales tools, as well as marketing and
        promotion methods. He possesses deep product knowledge, and is
        knowledgeable of industry trends, developments and challenges impacting
        channel partners. The Channel Sales Manager is self-motivated and
        service-oriented; able to effectively guide channel sales partners
        towards mutually beneficial priorities and objectives. He communicates
        product and product portfolio functionality and benefits in a simple and
        persuasive manner, ensuring that channel sales partners are
        self-sufficient.
  - source_sentence: >-
      The Deputy Director/Senior Assistant Director assists in setting the
      team's strategic direction and developing the annual budget and work
      plans. He/She develops and implements the operational policies and
      processes to facilitate the execution of new psychological treatments and
      practices, and leads quality improvement projects to enhance psychological
      services. He monitors staff workload and Key Performance Indicators (KPIs)
      and oversees the professional development of staff in the team.


      An experienced management staff with strong team management and project
      management skills, the Deputy Director/Senior Assistant Director is
      resourceful and practical in his approach. He works in varied settings
      such as public and private institutions, hospitals, healthcare
      organisations and voluntary welfare organisations.
    sentences:
      - Assistant Director of Clinical Services
      - ' Emerging Technology Advisor'
      - >-
        The Farm Manager oversees the farm management and is accountable for
        fulfilling sales target. He/She is responsible for strategic planning on
        farm production capability and capacity, as well as managing the
        operating budget, agri-inputs materials, resources, and manpower
        deployment.


        He leads farm production by establishing processes, systems, and 
        technology integration to ensure that farm production is achieved in a
        timely, cost-effective and sustainable manner. He prepares the
        production schedules and ensures productivity objectives and targets are
        met. He develops and incorporates Good Agricultural Practices, Food
        Safety Standards and Workplace Safety and Health practices in the entire
        farming operations. He also drives the adoption of innovative and smart
        farming technologies to continuously improve the overall productivity
        and efficiency of the farming operations.


        He is also responsible for leading the business development efforts to
        grow the farm business. He secures new clients and sales as well as
        takes part in agriculture industry events to promote the farm’s produce.
  - source_sentence: >-
      The Research Executive is responsible for analysing and presenting market
      insights and trends for the purpose of product and experience development.
      He/She plans and coordinates the research and development activities,
      develops robust methodologies to gather and process data that provides
      insights into emerging industry and facilitate knowledge sharing. He is
      responsible for overseeing the robustness and integrity of the data and
      information collection processes and for ensuring that programme contents
      are in line with the market-driven insights.


      Analytical and logical, he is highly proficient in the development and
      utilisation of research methods. He works with both internal and external
      stakeholders in directing and executing research and development
      activities, and is able to effectively communicate and break down complex
      data to relevant stakeholders.
    sentences:
      - Industry Trends Researcher
      - Research Methodologies Expert
      - >
        The Business Development Director/Country Route Development
        Director/Trade Lane Director/Freight Trade Director is responsible for
        developing new strategic business opportunities, client bases and
        managing business resources, including manpower and assets. He/She is
        also responsible for managing and engaging complex key accounts to
        develop trade development strategies and to develop strategic customer
        relationships.


        Resourceful and analytical, he is required to manage resources and
        obtain buy-in from internal and external stakeholders. He is also
        expected to lead a department and make business decisions independently.
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
  - cosine_accuracy
model-index:
  - name: modernbert-job-role-matcher
    results:
      - task:
          type: triplet
          name: Triplet
        dataset:
          name: Unknown
          type: unknown
        metrics:
          - type: cosine_accuracy
            value: 0.9649999737739563
            name: Cosine Accuracy

modernbert-job-role-matcher

This is a sentence-transformers model finetuned from nomic-ai/modernbert-embed-base. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: nomic-ai/modernbert-embed-base
  • Maximum Sequence Length: 8192 tokens
  • Output Dimensionality: 768 dimensions
  • Similarity Function: Cosine Similarity
  • Language: en
  • License: apache-2.0

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: ModernBertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("Fatin757/modernbert-job-role-matcher")
# Run inference
sentences = [
    'The Research Executive is responsible for analysing and presenting market insights and trends for the purpose of product and experience development. He/She plans and coordinates the research and development activities, develops robust methodologies to gather and process data that provides insights into emerging industry and facilitate knowledge sharing. He is responsible for overseeing the robustness and integrity of the data and information collection processes and for ensuring that programme contents are in line with the market-driven insights.\n\nAnalytical and logical, he is highly proficient in the development and utilisation of research methods. He works with both internal and external stakeholders in directing and executing research and development activities, and is able to effectively communicate and break down complex data to relevant stakeholders.',
    'Industry Trends Researcher',
    'The Business Development Director/Country Route Development Director/Trade Lane Director/Freight Trade Director is responsible for developing new strategic business opportunities, client bases and managing business resources, including manpower and assets. He/She is also responsible for managing and engaging complex key accounts to develop trade development strategies and to develop strategic customer relationships.\n\nResourceful and analytical, he is required to manage resources and obtain buy-in from internal and external stakeholders. He is also expected to lead a department and make business decisions independently.\n',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Triplet

Metric Value
cosine_accuracy 0.965

Training Details

Training Dataset

Unnamed Dataset

  • Size: 800 training samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 800 samples:
    anchor positive negative
    type string string string
    details
    • min: 73 tokens
    • mean: 180.48 tokens
    • max: 380 tokens
    • min: 4 tokens
    • mean: 6.82 tokens
    • max: 14 tokens
    • min: 59 tokens
    • mean: 171.41 tokens
    • max: 328 tokens
  • Samples:
    anchor positive negative
    The Helmsman manoeuvres and handles boats or crafts operating within the Port Limit of Singapore Territorial Waters. He/She is able to use the craft's navigational, fire-fighting and safety equipment and appreciate weather conditions, tides and tidal currents. He also performs basic chartwork, monitors and anticipates potential problems that may arise during daily operations and alerts the relevant authorities to them. He must pass a colour vision test and fulfil the requirements of the Port Limit Helmsman Licence issued by the Maritime and Port Authority of Singapore (MPA). Port Vessel Navigator The Quality Engineer identifies user requirements and expectations to inform quality standards for end-products, and analyses product development processes to identify relevant quality standards. He/She incorporates relevant and suitable international standards into product development processes, quality standards and testing processes. He identifies quality-testing types and variations based on business needs and requirements and develops testing processes. He identifies suitable measures of quality for testing and contributes to the development of test scenarios and plans. He conducts various quality tests, and analyses data to identify operating and usage conditions in which performance of quality measures starts to decline. He also automates quality testing for applicable and suitable tests.

    He works in a team setting and is proficient in programming languages required by the organisation. He is familiar with international quality standards, and uses test automation frameworks and...
    The Reservations Executive/Reservations Supervisor is responsible for supervising the operations of the department in selling rooms and managing room inventory to maximise sales. He/She ensures that all guest requests, concerns and feedback relating to rooms reservations are addressed in a timely and professional manner and collaborates with relevant departments on booking requirements and special guest requests to provide a seamless guest experience.

    He performs checks to ensure the accuracy of reservation bookings and records, keeps track of room availability and inventory, monitors room sales and occupancy levels and analyses reservations forecast to maximise the property's occupancy potential. He assists to meet monthly revenue targets by identifying new contacts and proposing promotional packages to increase room sales and revenue. He is also responsible for monitoring the team's compliance with the property's policies and procedures for reservations operations. He guides and coa...
    Room Reservations Manager The Site Reliability Engineering Manager drives the strategy for system operations and maintenance, ensuring highly reliable and scalable systems. He/She addresses multi-faceted issues and presents solutions to enhance and improve systems’ health and performance. He champions automation in developing resilient systems.

    He has expertise in both technical and business aspects of system development to bridge the gap between development and business functions. He is proficient in various security technologies, as well as cloud computing models and services. He works well with internal and external stakeholders to manage the demands of both. He collaborates with the development team to provide solutions that meet operational demands for high reliability and security.

    The Site Reliability Engineering Manager is a strategic thinker that develops robust application systems that meets business requirements. He adopts an innovative mindset to recommend new and emerging solutions. He is a stro...
    The Quality Engineer identifies user requirements and expectations to inform quality standards for end-products, and analyses product development processes to identify relevant quality standards. He/She incorporates relevant and suitable international standards into product development processes, quality standards and testing processes. He identifies quality-testing types and variations based on business needs and requirements and develops testing processes. He identifies suitable measures of quality for testing and contributes to the development of test scenarios and plans. He conducts various quality tests, and analyses data to identify operating and usage conditions in which performance of quality measures starts to decline. He also automates quality testing for applicable and suitable tests.

    He works in a team setting and is proficient in programming languages required by the organisation. He is familiar with international quality standards, and uses test automation frameworks and...
    Quality Assurance Engineer The Head - Analytics and Customer Insights is responsible for the strategic leadership of all customer and market research and analytics. He/She translates articulated and/or unarticulated business needs and hypotheses into research plans and methods that create business insights. He collaborates with other stakeholders and/or departments to set up the multi-platform customer measurement infrastructure and devises approaches for measuring the effectiveness of content, platforms and campaigns.

    The work involves providing technical guidance and leadership to the analytics and customer insights team as well as advising insights-based creative and business decision making.

    He should be an expert at both data and business metrics. He should have strong understanding of the fundamentals in quantitative and qualitative research techniques, algorithms, machine learning, natural language processing and statistical modelling. He ought to be an able communicator to convey insights to business ...
  • Loss: TripletLoss with these parameters:
    {
        "distance_metric": "TripletDistanceMetric.EUCLIDEAN",
        "triplet_margin": 5
    }
    

Evaluation Dataset

Unnamed Dataset

  • Size: 200 evaluation samples
  • Columns: anchor, positive, and negative
  • Approximate statistics based on the first 200 samples:
    anchor positive negative
    type string string string
    details
    • min: 73 tokens
    • mean: 178.67 tokens
    • max: 313 tokens
    • min: 4 tokens
    • mean: 6.95 tokens
    • max: 12 tokens
    • min: 80 tokens
    • mean: 172.03 tokens
    • max: 356 tokens
  • Samples:
    anchor positive negative
    The Reservations Executive/Reservations Supervisor is responsible for supervising the operations of the department in selling rooms and managing room inventory to maximise sales. He/She ensures that all guest requests, concerns and feedback relating to rooms reservations are addressed in a timely and professional manner and collaborates with relevant departments on booking requirements and special guest requests to provide a seamless guest experience.

    He performs checks to ensure the accuracy of reservation bookings and records, keeps track of room availability and inventory, monitors room sales and occupancy levels and analyses reservations forecast to maximise the property's occupancy potential. He assists to meet monthly revenue targets by identifying new contacts and proposing promotional packages to increase room sales and revenue. He is also responsible for monitoring the team's compliance with the property's policies and procedures for reservations operations. He guides and coa...
    Room Sales Coordinator The Executive (Load Control) determines load sheet requirements with airlines and develops manpower plans to support load control operations. He/She performs regular audits to ensure that the calculation of load limits, distribution and flight performance data complies with Standard Operating Procedures (SOPs). He also recommends enhancements to address areas of non-compliance and improves operational efficiencies. He develops SOPs to ensure alignment with safety and regulatory requirements, and is responsible for manpower deployment, developing on-the-job training programmes and workplace learning plans.

    Besides holding an Airlines Load and Trim Certification to perform his duties, the Executive (Load Control) also possesses outstanding data management and analytical skills. Moreover, he is comfortable with number crunching and is resilient to unforeseen interruptions and stressful situations. He also has excellent verbal and written communication skills and strong people management ...
    The Data Protection Officer executes data governance policies and procedures. He/She ensures the Data Protection Act is implemented and enforced in the organisation, and amongst the respective teams and users. He collaborates with business and project teams in projects and ensures alignment and compliance with the organisation's data protection guidelines and policies, and with industry standards and guidelines. He also directs a team of professionals and third-party vendors or service providers to achieve organisational goals in accordance with the data governance and data protection policies. He manages risks and data breach incidents. The Data Protection Officer is knowledgeable in areas of data governance, compliance and data protection policies and frameworks, and works within and across teams to mitigate data breaches. He is expected to be proficient in the requirements under the Personal Data Protection Act 2012. The Data Protection Officer adopts a broad and global perspective ... Data Compliance Officer The Customer Service Manager is responsible for managing overall customer service excellence, developing and reviewing process reviews and innovation frameworks and implementing customer service process review initiatives. He/She is also responsible for managing overall service quality and customer relationship management resources, including manpower, internal assets and external vendors.

    Resourceful and analytical, he is required to manage resources and obtain buy-in from internal and external stakeholders. He is also expected to lead teams and make business decisions independently.
    The Helmsman manoeuvres and handles boats or crafts operating within the Port Limit of Singapore Territorial Waters. He/She is able to use the craft's navigational, fire-fighting and safety equipment and appreciate weather conditions, tides and tidal currents. He also performs basic chartwork, monitors and anticipates potential problems that may arise during daily operations and alerts the relevant authorities to them. He must pass a colour vision test and fulfil the requirements of the Port Limit Helmsman Licence issued by the Maritime and Port Authority of Singapore (MPA). Maritime Craft Handler The Senior Executive - Product Management manages the development, launch and ongoing evolution of specific products for the organisation. He/She supports the development of the product's strategic roadmap with key market and research inputs. He collaborates with various teams to implement product improvements and new features by driving ongoing modifications or project implementation. He manages product feedback and translates it into product requirements for implementation by technical teams. He also collaborates with operations teams to understand product operations and scope for improvement.

    The work involves collaboration with business, technology and operations teams as well as keeping an eye on the market for product performance and competitor tracking.

    He needs to have a process-oriented mindset and an eye for detail. He is expected to be an effective project manager and able to manage multiple stakeholders. He also requires knowledge of the market trends and relevant technol...
  • Loss: TripletLoss with these parameters:
    {
        "distance_metric": "TripletDistanceMetric.EUCLIDEAN",
        "triplet_margin": 5
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • eval_strategy: epoch
  • per_device_train_batch_size: 4
  • per_device_eval_batch_size: 4
  • gradient_accumulation_steps: 4
  • learning_rate: 2e-05
  • lr_scheduler_type: cosine
  • warmup_ratio: 0.1
  • load_best_model_at_end: True
  • batch_sampler: no_duplicates

All Hyperparameters

Click to expand
  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: epoch
  • prediction_loss_only: True
  • per_device_train_batch_size: 4
  • per_device_eval_batch_size: 4
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 4
  • eval_accumulation_steps: None
  • torch_empty_cache_steps: None
  • learning_rate: 2e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1.0
  • num_train_epochs: 3
  • max_steps: -1
  • lr_scheduler_type: cosine
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.1
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • use_ipex: False
  • bf16: False
  • fp16: False
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: True
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: None
  • hub_always_push: False
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • include_for_metrics: []
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: False
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • use_liger_kernel: False
  • eval_use_gather_object: False
  • average_tokens_across_devices: False
  • prompts: None
  • batch_sampler: no_duplicates
  • multi_dataset_batch_sampler: proportional

Training Logs

Epoch Step Training Loss Validation Loss cosine_accuracy
1.0 50 - 4.3274 0.9800
2.0 100 17.5594 4.1967 0.9700
3.0 150 - 4.1762 0.965
  • The bold row denotes the saved checkpoint.

Framework Versions

  • Python: 3.11.12
  • Sentence Transformers: 4.1.0
  • Transformers: 4.52.3
  • PyTorch: 2.6.0+cu124
  • Accelerate: 1.7.0
  • Datasets: 2.14.4
  • Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

TripletLoss

@misc{hermans2017defense,
    title={In Defense of the Triplet Loss for Person Re-Identification},
    author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
    year={2017},
    eprint={1703.07737},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}