-
Notifications
You must be signed in to change notification settings - Fork 1
Expand file tree
/
Copy pathCITATION.cff
More file actions
105 lines (103 loc) · 3.24 KB
/
Copy pathCITATION.cff
File metadata and controls
105 lines (103 loc) · 3.24 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
cff-version: 1.2.0
message: "If you use this work, please cite the paper below."
title: "Synthetic Persona Pretraining: Alignment from Token Zero"
abstract: >-
Synthetic Persona Pretraining (SPP) installs a desired assistant persona from
token zero in pretraining by annotating pretraining documents with
first-person moral reflections derived from a normative value constitution,
pretraining on documents and reflections with the standard cross-entropy
loss, and post-training on user-assistant dialogue data, which binds the
desired persona to the assistant identity (persona binding). This umbrella
repository collects the project's data-generation, training, and evaluation
repositories as submodules.
type: software
repository-code: "https://github.com/epfl-dlab/spp"
authors:
# First three authors: equal contribution, alphabetical order.
- family-names: Minder
given-names: Julian
affiliation: "EPFL; MATS"
email: julian.minder@epfl.ch
- family-names: Moskvoretskii
given-names: Viktor
affiliation: EPFL
email: viktor.moskvoretskii@epfl.ch
- family-names: Singhal
given-names: Raghav
affiliation: EPFL
email: raghav.singhal@epfl.ch
- family-names: Jiao
given-names: Difan
affiliation: "University of Toronto"
- family-names: Arditi
given-names: Andy
affiliation: "Northeastern University"
- family-names: Cui
given-names: Shaobo
affiliation: "Shanghai Jiao Tong University"
- family-names: Borjigin
given-names: Yiderigun
affiliation: "Saarland University"
- family-names: Bali
given-names: Kartik
affiliation: "Helmholtz-Zentrum Hereon; TUHH"
- family-names: Krsteski
given-names: Stefan
affiliation: EPFL
- family-names: Raj
given-names: Harsh
affiliation: "Northeastern University"
- family-names: Nguyen
given-names: Huu
affiliation: "Ontocord AI"
- family-names: Brinkmann
given-names: Jannik
affiliation: "TU Clausthal; Northeastern University"
- family-names: Anderson
given-names: Ashton
affiliation: "University of Toronto"
- family-names: Aydin
given-names: Roland
affiliation: "Saarland University; DFKI"
- family-names: West
given-names: Robert
affiliation: EPFL
email: robert.west@epfl.ch
preferred-citation:
type: article
title: "Synthetic Persona Pretraining: Alignment from Token Zero"
year: 2026
journal: "arXiv preprint"
doi: 10.48550/arXiv.2608.13482
url: "https://arxiv.org/abs/2608.13482"
authors:
- family-names: Minder
given-names: Julian
- family-names: Moskvoretskii
given-names: Viktor
- family-names: Singhal
given-names: Raghav
- family-names: Jiao
given-names: Difan
- family-names: Arditi
given-names: Andy
- family-names: Cui
given-names: Shaobo
- family-names: Borjigin
given-names: Yiderigun
- family-names: Bali
given-names: Kartik
- family-names: Krsteski
given-names: Stefan
- family-names: Raj
given-names: Harsh
- family-names: Nguyen
given-names: Huu
- family-names: Brinkmann
given-names: Jannik
- family-names: Anderson
given-names: Ashton
- family-names: Aydin
given-names: Roland
- family-names: West
given-names: Robert