File to LDIF¶

Presentation¶

This script can map any CSV field or LDIF entries attributes to one or more LDIF entries attributes, with specific rules for DN generation and multi-values management.

This is written in Perl and uses:

Net::LDAP::LDIF

Text::CSV (only if CSV as input file)

Text::Unaccent (only if (fmail) macro is used)

Configuration¶

You have to edit the script to modify the configuration:

$ vi file2ldif.pl

Parameters are:

csv_delimiter: separator of CSV fields

csv_strip_headers: set to 1 if CSV file has columns name at first line

beginc: begin delimiter for field container

endc: end delimiter for field container

map: all task and mapping rules (see below)

You can define tasks to manage different CSV file structures. For example you can have one CSV file for users and another for groups. So the task name is the first level in the hash map, such as “person” and “group” in this example:

my $map => {
    person => { ... }
    group => { ... }
};

The task name is important because it will be used as a command line parameter to the script.

Then, in each task, you will define the mapping with the Net::LDAP::Entry syntax.

You will map fields with {i}, i being the field number for CSV, and the attribute name for LDIF (you can adjust begin and end delimiter in parameters $beginc and $endc).

CSV example¶

If you have a CSV file with 3 columns, you can use {0}, {1} and {2} to map them. Here are two CSV file examples:

example-users.csv:

Login;"First Name";"Last Name"
coudot;Clément;OUDOT
jclarke;Jonathan;CLARKE

example-groups.csv:

Group name;Default member
group1;coudot
group2;jclarke

Below is a sample configuration to parse those files:

my $map = {
    person => {
        dn => 'uid={1},ou=users,dc=example,dc=com',
        objectClass => [ 'top', 'person', 'organizationalPerson', 'inetOrgPerson' ],
        uid => '{1}',
        givenName => '{2}',
        sn => '{3}',
        cn => '{2} {3}',
    },
    group => {
        dn => 'cn={1},ou=groups,dc=example,dc=com',
        objectClass => [ 'top', 'groupOfUniqueNames' ],
        cn => '{1}',
        uniqueMember => 'uid={2},ou=users,dc=example,dc=com',
    },
};

LDIF example¶

Here is a sample entry from an LDIF extract of users:

dn: cn=clide,ou=users,dc=acme,dc=com
objectClass: top
objectClass: person
cn: clide
sn: barrow
employeeType: gangster

You can create one task to reformat the user entry, and another to add the user in a group (whose name depends on employeeType attribute):

my $map = {
    person => {
        dn => 'uid={cn},ou=users,dc=example,dc=com',
        objectClass => [ 'top', 'person', 'organizationalPerson', 'inetOrgPerson' ],
        uid => '{cn}',,
        sn => '{(uc)sn}',
        cn => '{cn}',
    },
    group => {
        change_op => 'add',
        dn => 'cn={employeeType},ou=groups,dc=example,dc=com',
        uniqueMember => 'uid={cn},ou=users,dc=example,dc=com',
    },
};

Change operations¶

By default, generated LDIF uses a changetype: add, this means you want to add complete entries.

You can set a third command line parameter to use other changetypes:

modify

delete

modrdn

In modify case, you can add the change_op field inside a task to determine which change operation will be performed:

add

delete

replace

Macros¶

You can use macros in mapping, for example to lower-case values.

Available macros are:

lc: lower case

lcfirst: lower case first letter

uc: upper case

ucfirst: upper case first letter

ucfirstlc: lower case all and upper case fisrt letter

fmail: format string to fit mail address (lower case, replace spaces by - and remove accents)

Example:

$map => {
    person => {
        change_op => replace,
        dn => 'uid={(lc)uid},ou=users,dc=example,dc=com,
        mail => '{(fmail)givenname}.{(fmail}sn}@example.com',
    }
};

Run¶

You can run the script like this:

$ perl file2ldif.pl <taskname> <file> <changetype>

It will produce a taskname.ldif file.

For our CSV examples, this will be:

$ perl file2ldif.pl person example-users.csv
$ perl file2ldif.pl group example-groups.csv

And resulting LDIF are:

person.ldif:

dn: uid=coudot,ou=users,dc=example,dc=com
uid: coudot
cn:: Q2zDqW1lbnQgT1VET1Q=
sn: OUDOT
objectClass: top
objectClass: person
objectClass: organizationalPerson
objectClass: inetOrgPerson
givenName:: Q2zDqW1lbnQ=

dn: uid=jclarke,ou=users,dc=example,dc=com
uid: jclarke
cn: Jonathan CLARKE
sn: CLARKE
objectClass: top
objectClass: person
objectClass: organizationalPerson
objectClass: inetOrgPerson
givenName: Jonathan

group.ldif:

dn: cn=group1,ou=groups,dc=example,dc=com
cn: group1
uniqueMember: uid=coudot,ou=users,dc=example,dc=com
objectClass: top
objectClass: groupOfUniqueNames

dn: cn=group2,ou=groups,dc=example,dc=com
cn: group2
uniqueMember: uid=jclarke,ou=users,dc=example,dc=com
objectClass: top
objectClass: groupOfUniqueNames

Real life use cases¶

Create test entries¶

Imagine you want to create 1000 test entries with different login and password.

First, use a simple loop to generate a CSV file:

$ echo "login;password" > test-users.csv
$ for i in `seq 1 1000`; do echo "user$i;password$i" >>  test-users.csv; done

Then configure the mapping in file2ldif.pl script:

my $map = {
    test => {
        dn => 'uid={1},ou=users,dc=example,dc=com',
        objectClass => [ 'top', 'person', 'organizationalPerson', 'inetOrgPerson' ],
        uid => '{1}',
        sn => '{1}',
        cn => '{1}',
        userPassword => '{2}',
    },
};

And run:

$ perl file2ldif.pl test test-users.csv

Add the users in you directory:

$ ldapadd -D cn=manager,dc=example,dc=com -W -f test.ldif

Replace an attribute for all users¶

Imagine you want to change to employeeType value of some users from “gangster” to “cop”.

First you will get an LDIF of concerned users:

$ ldapsearch -b ou=users,dc=example,dc=com '(employeeType=gangster)' -LLL > gangsters.ldif

Then configure the mapping in file2ldif.pl script:

my $map = {
    justice => {
        change_op => 'replace',
        dn => '{dn}',
        employeeType => 'cop',
    },
};

And run:

$ perl file2ldif.pl justice gangsters.ldif modify

Apply changes in your directory:

$ ldapmodify -D cn=manager,dc=example,dc=com -W -f justice.ldif

Download¶

This script, along with all ldap scripts from this site, can be downloaded from the LTB repository.