Module Csv

module Csv: sig .. end

Read and write the CSV (comma separated values) format.

This library should be compatible with RFC4180 if one sets strip=false in the creation functions.
Author(s): Richard Jones <rjones@redhat.com>, Christophe Troestler <Christophe.Troestler@umons.ac.be>

type t = string list list

Representation of CSV data in memory. This is a list of rows (also called records), each row being a list of columns.

Input/output objects

class type in_obj_channel = object .. end

The most basic input object for best interoperability.

class type out_obj_channel = object .. end

The most basic output object for best interoperability.

Input

exception Failure of int * int * string

Failure(nrecord, nfield, msg) is raised to indicate a parsing error for the field number nfield on the record number nrecord, the description msg says what is wrong. The first record and the first field of a record are numbered 1 (to correspond to the usual spreadsheet numbering but differing from List.nth of the OCaml representation).

type in_channel

Stateful handle to input CSV files.

val of_in_obj : ?separator:char ->
       ?strip:bool ->
       ?has_header:bool ->
       ?header:string list ->
       ?backslash_escape:bool ->
       ?excel_tricks:bool -> in_obj_channel -> in_channel

of_in_obj ?separator ?excel_tricks in_chan creates a new "channel" to access the data in CSV form available from the channel in_chan.

separator : What character the separator is. The default is ','. You should be aware however that, in the countries where comma is used as a decimal separator, Excel will use ';' as the separator.

strip : Whether to remove the white space around unquoted fields. The default is true for backward compatibility reasons.

has_header : tells that the first row of the CSV channel is to be interpreted as a header (this row will not be returned by Csv.next). This is useful to use the functions in the Csv.Rows module below. Default: false.

header : Supply the header to use for this CSV channel. If both header and has_header are given, the names of header take precedence; if a name in header is "", the one in the CSV header is used. If a name appears twice, only its first occurrence is used.

backslash_escape : Whether to allow \", \n,... in quoted fields. This is used by MySQL for example but is not standard CSV so it is set to false by default.

excel_tricks : enables Excel tricks, namely the fact that '"' followed by '0' in a quoted string means ASCII NULL and the fact that a field of the form ="..." only returns the string inside the quotes. Default: true.

val of_channel : ?separator:char ->
       ?strip:bool ->
       ?has_header:bool ->
       ?header:string list ->
       ?backslash_escape:bool ->
       ?excel_tricks:bool -> Pervasives.in_channel -> in_channel

Same as Csv.of_in_obj except that the data is read from a standard channel.

val of_string : ?separator:char ->
       ?strip:bool ->
       ?has_header:bool ->
       ?header:string list ->
       ?backslash_escape:bool -> ?excel_tricks:bool -> string -> in_channel

Same as Csv.of_in_obj except that the data is read from a string.

val load : ?separator:char ->
       ?strip:bool ->
       ?backslash_escape:bool -> ?excel_tricks:bool -> string -> t

load fname loads the CSV file fname. If filename is "-" then load from stdin.

backslash_escape : Whether to allow \", \n,... in quoted fields. This is used by MySQL for example but is not standard CSV so it is set to false by default.

val load_in : ?separator:char ->
       ?strip:bool ->
       ?backslash_escape:bool ->
       ?excel_tricks:bool -> Pervasives.in_channel -> t

load_in ch loads a CSV file from the input channel ch. See Csv.load for the meaning of separator and excel_tricks.

val to_in_obj : in_channel -> in_obj_channel

For efficiency reasons, the in_channel buffers the data from the original channel. If you want to examine the data by other means than the methods below (say after a failure), you need to use this function in order not to "loose" data in the buffer.

val close_in : in_channel -> unit

close_in ic closes the channel ic. The underlying channel is closed as well.

val next : in_channel -> string list

next ic returns the next record in the CSV file.
Raises

End_of_file if no more record can be read.
Csv.Failure if the CSV format is not respected. The partial record read is available with #current_record.

val fold_left : f:('a -> string list -> 'a) -> init:'a -> in_channel -> 'a

fold_left f a ic computes (f ... (f (f a r0) r1) ... rN) where r1,...,rN are the records in the CSV file. If f raises an exception, the record available at that moment is accessible through Csv.current_record.

val fold_right : f:(string list -> 'a -> 'a) -> in_channel -> 'a -> 'a

fold_right f ic a computes (f r1 ... (f rN-1 (f rN a)) ...) where r1,...,rN-1, rN are the records in the CSV file. All records are read before applying f so this method is not convenient if your file is large.

val iter : f:(string list -> unit) -> in_channel -> unit

iter f ic iterates f on all remaining records. If f raises an exception, the record available at that moment is accessible through Csv.current_record.

val input_all : in_channel -> t

input_all ic return a list of the CSV records till the end of the file.

val current_record : in_channel -> string list

The current record under examination. This is useful in order to gather the parsed data in case of Failure.

val load_rows : ?separator:char ->
       ?strip:bool ->
       ?backslash_escape:bool ->
       ?excel_tricks:bool -> (string list -> unit) -> Pervasives.in_channel -> unit

Deprecated.use Csv.iter on a Csv.in_channel created with Csv.of_channel.

Output

type out_channel

val to_out_obj : ?separator:char ->
       ?backslash_escape:bool ->
       ?excel_tricks:bool -> out_obj_channel -> out_channel

to_out_obj ?separator ?excel_tricks out_chan creates a new "channel" to output the data in CSV form.

separator : What character the separator is. The default is ','.

backslash_escape : Prefer to escape the separator in a quoted string with a backslash (e.g. "\"") instead of doubling it. Also backslash-escape '\n', '\r', '\t', '\b', '\026' (as '\Z') and '\000' (as '\0') This is nice for interoperability but is nonstandard CSV to it is set to false by default.

excel_tricks : enables Excel tricks, namely the fact that '\000' is represented as '"' followed by '0' and the fact that a field with leading or trailing spaces or a leading '0' will be encoded as ="..." (to avoid Excel "helping" you). Default: false.

val to_channel : ?separator:char ->
       ?backslash_escape:bool ->
       ?excel_tricks:bool -> Pervasives.out_channel -> out_channel

Same as Csv.to_out_obj but output to a standard channel.

val to_buffer : ?separator:char ->
       ?backslash_escape:bool -> ?excel_tricks:bool -> Buffer.t -> out_channel

Same as Csv.to_out_obj but output to a buffer.

val output_record : out_channel -> string list -> unit

output_record oc r write the record r is CSV form to the channel oc.

val output_all : out_channel -> t -> unit

output_all oc csv outputs all records in csv to the channel oc.

val save_out : ?separator:char ->
       ?backslash_escape:bool ->
       ?excel_tricks:bool -> Pervasives.out_channel -> t -> unit

Deprecated.Save string list list to a channel.

val save : ?separator:char ->
       ?backslash_escape:bool -> ?excel_tricks:bool -> string -> t -> unit

save fname csv saves the csv data to the file fname.

val print : ?separator:char ->
       ?backslash_escape:bool -> ?excel_tricks:bool -> t -> unit

Print the CSV data.

val print_readable : t -> unit

Print the CSV data to stdout in a human-readable format. Not much is guaranteed about how the CSV is printed, except that it will be easier to follow than a "raw" output done with Csv.print. This is a one-way operation. There is no easy way to parse the output of this command back into CSV data.

val save_out_readable : Pervasives.out_channel -> t -> unit

As for Csv.print_readable, allowing the output to be sent to a channel.

Functions to access rows when a header is present

module Row: sig .. end

A row with a header.

module Rows: sig .. end

Accessing rows (when a header was provided).

Functions acting on CSV data loaded in memory

val lines : t -> int

Return the number of lines in a CSV data.

val columns : t -> int

Work out the (maximum) number of columns in a CSV file. Note that each line may be a different length, so this finds the one with the most columns.

val trim : ?top:bool -> ?left:bool -> ?right:bool -> ?bottom:bool -> t -> t

This takes a CSV file and trims empty cells.

All four of the option arguments (~top, ~left, ~right, ~bottom) default to true.

The exact behaviour is:

~right: If true, remove any empty cells at the right hand end of any row. The number of columns in the resulting CSV structure will not necessarily be the same for each row.

~top: If true, remove any empty rows (no cells, or containing just empty cells) from the top of the CSV structure.

~bottom: If true, remove any empty rows from the bottom of the CSV structure.

~left: If true, remove any empty columns from the left of the CSV structure. Note that ~left and ~right are quite different: ~left considers the whole CSV structure, whereas ~right considers each row in isolation.

val square : t -> t

Make the CSV data "square" (actually rectangular). This pads out each row with empty cells so that all rows are the same length as the longest row. After this operation, every row will have length Csv.columns.

val is_square : t -> bool

Return true iff the CSV is "square" (actually rectangular). This means that each row has the same number of cells.

val set_columns : cols:int -> t -> t

set_columns cols csv makes the CSV data square by forcing the width to the given number of cols. Any short rows are padded with blank cells. Any long rows are truncated.

val set_rows : rows:int -> t -> t

set_rows rows csv makes the CSV data have exactly rows rows by adding empty rows or truncating rows as necessary.

Note that set_rows does not make the CSV square. If you want it to be square, call either Csv.square or Csv.set_columns after.

val set_size : rows:int -> cols:int -> t -> t

set_size rows cols csv makes the CSV data square by forcing the size to rows * cols, adding blank cells or truncating as necessary. It is the same as calling

set_columns cols
      (set_rows rows csv)

val sub : r:int -> c:int -> rows:int -> cols:int -> t -> t

sub r c rows cols csv returns a subset of csv. The subset is defined as having top left corner at row r, column c (counting from 0) and being rows deep and cols wide.

The returned CSV will be "square".

val compare : t -> t -> int

Compare two CSV files for equality, ignoring blank cells at the end of a row, and empty rows appended to one or the other. This is "semantic" equality - roughly speaking, the two CSV files would look the same if opened in a spreadsheet program.

val concat : t list -> t

Concatenate CSV files so that they appear side by side, arranged left to right across the page. Each CSV file (except the final one) is first squared.

(To concatenate CSV files so that they appear from top to bottom, just use List.concat).

val transpose : t -> t

Permutes the lines and columns of the CSV data. Nonexistent cells become empty cells after transpose if they must be created.

val to_array : t -> string array array

val of_array : string array array -> t

Convenience functions to convert to and from a matrix representation. to_array will produce a ragged matrix (not all rows will have the same length) unless you call Csv.square first.

val associate : string list -> t -> (string * string) list list

associate header data takes a block of data and converts each row in turn into an assoc list which maps column header to data cell.

Typically a spreadsheet will have the format:

      header1   header2   header3
      data11    data12    data13
      data21    data22    data23
      ...

This function arranges the data into a more usable form which is robust against changes in column ordering. The output of the function is:

      [ ["header1", "data11"; "header2", "data12"; "header3", "data13"];
        ["header1", "data21"; "header2", "data22"; "header3", "data23"];
        etc. ]

Each row is turned into an assoc list (see List.assoc).

If a row is too short, it is padded with empty cells (""). If a row is too long, it is truncated.

You would typically call this function as:

    let header, data = match csv with h :: d -> h, d | [] -> assert false;;
    let data = Csv.associate header data;;

The header strings are shared, so the actual space in memory consumed by the spreadsheet is not much larger.

val map : f:(string -> string) -> t -> t

map f csv applies f to all entries of csv and returns the resulting CSV.