Preference & eval data

Formal Modern Standard Arabic for RLHF / DPO.

20 expert-audited Formal MSA pairs · diagnostic on request · larger packs by engagement

Diagnostic = short Formal MSA fail sample + option to request the full JSON/CSV pack.

Frontier models still pick the wrong Formal MSA preference answer — fluent-looking Arabic that fails school-standard grammar, morphology, or diacritics.

Request a diagnostic: a short fail sample, plus the option for the full JSON/CSV pack. Larger packs by engagement. Islamic Fiqh/Fatwa and GCC legal stay Coming next.

  • Core offer Formal MSA preference pairs — prompt · rejected · chosen · rationale · JSON/CSV
  • Coming next Islamic Fiqh/Fatwa · GCC legal

Services

What we deliver.

Four pillars. Core offer: 20 expert-audited Formal MSA preference pairs. Expert rationales ride with every pair — not a separate SFT catalog. Dialects are Coming next.

  • Network

    Expert review

    Lead reviewer: UAE MoE-accredited Arabic educator (30+ years classroom). Expanding faculty / academic review network.

  • Core offer

    RLHF preference pairs

    Chosen vs rejected answers that catch fluent-looking but wrong failures — plus the rationale that makes the preference trainable. The core of every pack.

    Delivered as JSON or CSV — ready for your training stack. Not locked in spreadsheets.

  • With every pair

    Expert rationales

    Expert explanations of why the gold answer wins — usable in preference learning, and as structured traces for supervised fine-tuning workflows. Not a standalone multi-step chain-of-thought product line.

  • Core offer

    Arabic depth

    Formal MSA where grammar and meaning break models — iʿrāb, morphology, diacritics, syntax, academic register. Preference content is Arabic; EN/AR packaging and sales docs are fine. Dialects: Coming next.

Capabilities

What Formal Modern Standard Arabic preference covers.

Modern Standard Arabic — the formal written Arabic used in schools, media, and official settings (not dialects).

Grammar (nahw) — case, syntax, agreement

Case and agreement errors silently rewrite who did what.

Core offer: Formal MSA preference pairs — each row is prompt, rejected (A), chosen (B), and expert rationale. Preference content is Arabic. Packaging and sales docs can be English or Arabic. Dialects out of scope for v1.

Sample

A real preference pack row — not a logo wall.

How a Formal MSA pack row is built. Scroll three Formal Modern Standard Arabic excerpts. Packs deliver as JSON or CSV for RLHF / DPO pipelines; a free diagnostic may still be PDF or sample pairs — not every teaser attach is the pack file.

  1. 1. PromptThe task
  2. 2. Rejected (A)Common / model-wrong
  3. 3. Chosen (B)Expert gold
  4. 4. RationaleWhy B · why not A

Sample rows from the expert-audited Formal Modern Standard Arabic pack

Pack row — JSON

DIRAYA-AR-001 · seeds_v1_msa_formal.jsonl

Real AATO fields from the seed file. Long strings truncated for display (marked …) — full Arabic text is in the carousel above. Download the full sample row below.

Download sample pair (JSON)

{
  "aato_id": "DIRAYA-UAE-2026-001",
  "seed_id": "DIRAYA-AR-001",
  "domain": "Arabic_Linguistics",
  "subdomain": "Nahw_Irab_MafoolMaahu",
  "prompt": {
    "user_input": "أعرِبْ ما تحته خطّ إعرابًا تفصيليًّا موجَّهًا لطالب الصفّ الثاني عشر: «سارَ القائدُ والجبلَ حتّى أدركَ الحصنَ». هل تُعرَبُ «الجبلَ» مفعولًا معه أم معطوفًا؟ ومتى يمتنع العطفُ هنا؟ أجب بتشكيلٍ كاملٍ للكلمةِ المعرَبةِ وبيانِ العلامةِ"
  },
  "candidates": [
    {
      "id": "c0_model_rejected",
      "text": "الواوُ هنا تحتملُ العطفَ والمعيّةَ، والأفصحُ المدرسيُّ عندَ جمعٍ من المعربينَ حملُها على العطفِ؛ فـ«الجَبَلُ» معطوفٌ على «القائدُ» مرفوعٌ مثلهُ"
    },
    {
      "id": "c1_expert_chosen",
      "text": "الراجحُ في هذا التركيبِ أنْ تُعرَبَ «الجَبَلَ» مفعولًا معهُ منصوبًا وعلامةُ نصبِه الفتحةُ الظاهرةُ، والواوُ واوُ المعيّةِ لا عاطفةٌ",
      "rationale": "الاستجابةُ (b) هي الصحيحة ؛ لأن القاعدة تقول : يَمْتَنِعُ الْعَطْفُ، وَيَجِبُ إِعْرَابُ الِاسْمِ بَعْدَ الْوَاوِ مَفْعُولًا مَعَهُ"
    }
  ],
  "preference": {
    "chosen_id": "c1_expert_chosen",
    "rejected_id": "c0_model_rejected"
  }
}

Proof

Format. Scope. Verification.

No invented win rates. No customer logo theater. 20 expert-audited Formal MSA pairs · diagnostic on request · larger packs by engagement.

  • Format

    JSON or CSV

    Delivered as JSON or CSV — buyer’s choice — machine-readable for training / RLHF-DPO pipelines. Not spreadsheet handoffs as the primary deliverable. Each row: prompt · rejected (A) · chosen (B) · expert rationale. Free diagnostic may be PDF or sample; packs deliver JSON/CSV.

  • Scope

    Formal MSA now

    Grammar, morphology, diacritics, and syntax — school and official-curriculum Formal MSA. Preference pairs are Arabic. Packaging and sales docs can be EN or AR. Fiqh is Coming next, not live.

  • Verification

    Educator review

    Lead reviewer: UAE MoE-accredited Arabic educator (30+ years classroom). Expanding faculty / academic review network.

Coming next

Same rigor. Roadmap domains.

Formal MSA preference pairs are Arabic today. Packaging and sales docs can be English or Arabic. Everything below is in development — not sold as live. Fiqh needs Sharia co-audit before any enterprise claim.

  • Coming next

    Islamic Fiqh & Fatwa preference

    Not live

    Personal status, Islamic finance, mirath. Needs Sharia co-auditor (or explicit madhhab + jurisdiction disclaimer) before enterprise release. Not live.

  • Coming next

    GCC legal / personal status

    Not live

    Jurisdiction-aware Gulf personal-status and related legal coverage — Coming next.

  • Coming next

    STEM / physics / science academic

    Not live

    Academic science preference where models still bleed calques — Coming next.

  • Coming next

    Faculty / expert network

    Not live

    Expanding the verified educator and domain-expert network for Formal MSA and future domains.