Provided by: erlang-manpages_20.2.2+dfsg-1ubuntu2_all 
NAME
file - File interface module.
DESCRIPTION
This module provides an interface to the file system.
On operating systems with thread support, file operations can be performed in threads of
their own, allowing other Erlang processes to continue executing in parallel with the file
operations. See command-line flag +A in erl(1).
Regarding filename encoding, the Erlang VM can operate in two modes. The current mode can
be queried using function native_name_encoding/0. It returns latin1 or utf8.
In latin1 mode, the Erlang VM does not change the encoding of filenames. In utf8 mode,
filenames can contain Unicode characters greater than 255 and the VM converts filenames
back and forth to the native filename encoding (usually UTF-8, but UTF-16 on Windows).
The default mode depends on the operating system. Windows and MacOS X enforce consistent
filename encoding and therefore the VM uses utf8 mode.
On operating systems with transparent naming (for example, all Unix systems except MacOS
X), default is utf8 if the terminal supports UTF-8, otherwise latin1. The default can be
overridden using +fnl (to force latin1 mode) or +fnu (to force utf8 mode) when starting
erts:erl.
On operating systems with transparent naming, files can be inconsistently named, for
example, some files are encoded in UTF-8 while others are encoded in ISO Latin-1. The
concept of raw filenames is introduced to handle file systems with inconsistent naming
when running in utf8 mode.
A raw filename is a filename specified as a binary. The Erlang VM does not translate a
filename specified as a binary on systems with transparent naming.
When running in utf8 mode, functions list_dir/1 and read_link/1 never return raw
filenames. To return all filenames including raw filenames, use functions list_dir_all/1
and read_link_all/1.
See also section Notes About Raw Filenames in the STDLIB User's Guide.
DATA TYPES
deep_list() = [char() | atom() | deep_list()]
fd()
A file descriptor representing a file opened in raw mode.
filename() = string()
filename_all() = string() | binary()
io_device() = pid() | fd()
As returned by open/2; pid() is a process handling I/O-protocols.
name() = string() | atom() | deep_list()
If VM is in Unicode filename mode, string() and char() are allowed to be > 255.
name_all() =
string() | atom() | deep_list() | (RawFilename :: binary())
If VM is in Unicode filename mode, string() and char() are allowed to be > 255.
RawFilename is a filename not subject to Unicode translation, meaning that it can
contain characters not conforming to the Unicode encoding expected from the file
system (that is, non-UTF-8 characters although the VM is started in Unicode
filename mode).
posix() =
eacces |
eagain |
ebadf |
ebusy |
edquot |
eexist |
efault |
efbig |
eintr |
einval |
eio |
eisdir |
eloop |
emfile |
emlink |
enametoolong |
enfile |
enodev |
enoent |
enomem |
enospc |
enotblk |
enotdir |
enotsup |
enxio |
eperm |
epipe |
erofs |
espipe |
esrch |
estale |
exdev
An atom that is named from the POSIX error codes used in Unix, and in the runtime
libraries of most C compilers.
date_time() = calendar:datetime()
Must denote a valid date and time.
file_info() =
#file_info{size = integer() >= 0 | undefined,
type =
device |
directory |
other |
regular |
symlink |
undefined,
access =
read | write | read_write | none | undefined,
atime =
file:date_time() |
integer() >= 0 |
undefined,
mtime =
file:date_time() |
integer() >= 0 |
undefined,
ctime =
file:date_time() |
integer() >= 0 |
undefined,
mode = integer() >= 0 | undefined,
links = integer() >= 0 | undefined,
major_device = integer() >= 0 | undefined,
minor_device = integer() >= 0 | undefined,
inode = integer() >= 0 | undefined,
uid = integer() >= 0 | undefined,
gid = integer() >= 0 | undefined}
location() =
integer() |
{bof, Offset :: integer()} |
{cur, Offset :: integer()} |
{eof, Offset :: integer()} |
bof |
cur |
eof
mode() =
read |
write |
append |
exclusive |
raw |
binary |
{delayed_write,
Size :: integer() >= 0,
Delay :: integer() >= 0} |
delayed_write |
{read_ahead, Size :: integer() >= 1} |
read_ahead |
compressed |
{encoding, unicode:encoding()} |
sync
file_info_option() =
{time, local} | {time, universal} | {time, posix} | raw
EXPORTS
advise(IoDevice, Offset, Length, Advise) -> ok | {error, Reason}
Types:
IoDevice = io_device()
Offset = Length = integer()
Advise = posix_file_advise()
Reason = posix() | badarg
posix_file_advise() =
normal |
sequential |
random |
no_reuse |
will_need |
dont_need
advise/4 can be used to announce an intention to access file data in a specific
pattern in the future, thus allowing the operating system to perform appropriate
optimizations.
On some platforms, this function might have no effect.
allocate(File, Offset, Length) -> ok | {error, posix()}
Types:
File = io_device()
Offset = Length = integer() >= 0
allocate/3 can be used to preallocate space for a file.
This function only succeeds in platforms that provide this feature. When it
succeeds, space is preallocated for the file but the file size might not be
updated. This behaviour depends on the preallocation implementation. To guarantee
that the file size is updated, truncate the file to the new size.
change_group(Filename, Gid) -> ok | {error, Reason}
Types:
Filename = name_all()
Gid = integer()
Reason = posix() | badarg
Changes group of a file. See write_file_info/2.
change_mode(Filename, Mode) -> ok | {error, Reason}
Types:
Filename = name_all()
Mode = integer()
Reason = posix() | badarg
Changes permissions of a file. See write_file_info/2.
change_owner(Filename, Uid) -> ok | {error, Reason}
Types:
Filename = name_all()
Uid = integer()
Reason = posix() | badarg
Changes owner of a file. See write_file_info/2.
change_owner(Filename, Uid, Gid) -> ok | {error, Reason}
Types:
Filename = name_all()
Uid = Gid = integer()
Reason = posix() | badarg
Changes owner and group of a file. See write_file_info/2.
change_time(Filename, Mtime) -> ok | {error, Reason}
Types:
Filename = name_all()
Mtime = date_time()
Reason = posix() | badarg
Changes the modification and access times of a file. See write_file_info/2.
change_time(Filename, Atime, Mtime) -> ok | {error, Reason}
Types:
Filename = name_all()
Atime = Mtime = date_time()
Reason = posix() | badarg
Changes the modification and last access times of a file. See write_file_info/2.
close(IoDevice) -> ok | {error, Reason}
Types:
IoDevice = io_device()
Reason = posix() | badarg | terminated
Closes the file referenced by IoDevice. It mostly returns ok, except for some
severe errors such as out of memory.
Notice that if option delayed_write was used when opening the file, close/1 can
return an old write error and not even try to close the file. See open/2.
consult(Filename) -> {ok, Terms} | {error, Reason}
Types:
Filename = name_all()
Terms = [term()]
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
Reads Erlang terms, separated by '.', from Filename. Returns one of the following:
{ok, Terms}:
The file was successfully read.
{error, atom()}:
An error occurred when opening the file or reading it. For a list of typical
error codes, see open/2.
{error, {Line, Mod, Term}}:
An error occurred when interpreting the Erlang terms in the file. To convert
the three-element tuple to an English description of the error, use
format_error/1.
Example:
f.txt: {person, "kalle", 25}.
{person, "pelle", 30}.
1> file:consult("f.txt").
{ok,[{person,"kalle",25},{person,"pelle",30}]}
The encoding of Filename can be set by a comment, as described in epp(3erl).
copy(Source, Destination) -> {ok, BytesCopied} | {error, Reason}
copy(Source, Destination, ByteCount) ->
{ok, BytesCopied} | {error, Reason}
Types:
Source = Destination = io_device() | Filename | {Filename, Modes}
Filename = name_all()
Modes = [mode()]
ByteCount = integer() >= 0 | infinity
BytesCopied = integer() >= 0
Reason = posix() | badarg | terminated
Copies ByteCount bytes from Source to Destination. Source and Destination refer to
either filenames or IO devices from, for example, open/2. ByteCount defaults to
infinity, denoting an infinite number of bytes.
Argument Modes is a list of possible modes, see open/2, and defaults to [].
If both Source and Destination refer to filenames, the files are opened with [read,
binary] and [write, binary] prepended to their mode lists, respectively, to
optimize the copy.
If Source refers to a filename, it is opened with read mode prepended to the mode
list before the copy, and closed when done.
If Destination refers to a filename, it is opened with write mode prepended to the
mode list before the copy, and closed when done.
Returns {ok, BytesCopied}, where BytesCopied is the number of bytes that was
copied, which can be less than ByteCount if end of file was encountered on the
source. If the operation fails, {error, Reason} is returned.
Typical error reasons: as for open/2 if a file had to be opened, and as for read/2
and write/2.
datasync(IoDevice) -> ok | {error, Reason}
Types:
IoDevice = io_device()
Reason = posix() | badarg | terminated
Ensures that any buffers kept by the operating system (not by the Erlang runtime
system) are written to disk. In many ways it resembles fsync but it does not update
some of the metadata of the file, such as the access time. On some platforms this
function has no effect.
Applications that access databases or log files often write a tiny data fragment
(for example, one line in a log file) and then call fsync() immediately to ensure
that the written data is physically stored on the hard disk. Unfortunately, fsync()
always initiates two write operations: one for the newly written data and another
one to update the modification time stored in the inode. If the modification time
is not a part of the transaction concept, fdatasync() can be used to avoid
unnecessary inode disk write operations.
Available only in some POSIX systems, this call results in a call to fsync(), or
has no effect in systems not providing the fdatasync() syscall.
del_dir(Dir) -> ok | {error, Reason}
Types:
Dir = name_all()
Reason = posix() | badarg
Tries to delete directory Dir. The directory must be empty before it can be
deleted. Returns ok if successful.
Typical error reasons:
eacces:
Missing search or write permissions for the parent directories of Dir.
eexist:
The directory is not empty.
enoent:
The directory does not exist.
enotdir:
A component of Dir is not a directory. On some platforms, enoent is returned
instead.
einval:
Attempt to delete the current directory. On some platforms, eacces is returned
instead.
delete(Filename) -> ok | {error, Reason}
Types:
Filename = name_all()
Reason = posix() | badarg
Tries to delete file Filename. Returns ok if successful.
Typical error reasons:
enoent:
The file does not exist.
eacces:
Missing permission for the file or one of its parents.
eperm:
The file is a directory and the user is not superuser.
enotdir:
A component of the filename is not a directory. On some platforms, enoent is
returned instead.
einval:
Filename has an improper type, such as tuple.
Warning:
In a future release, a bad type for argument Filename will probably generate an
exception.
eval(Filename) -> ok | {error, Reason}
Types:
Filename = name_all()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
Reads and evaluates Erlang expressions, separated by '.' (or ',', a sequence of
expressions is also an expression) from Filename. The result of the evaluation is
not returned; any expression sequence in the file must be there for its side
effect. Returns one of the following:
ok:
The file was read and evaluated.
{error, atom()}:
An error occurred when opening the file or reading it. For a list of typical
error codes, see open/2.
{error, {Line, Mod, Term}}:
An error occurred when interpreting the Erlang expressions in the file. To
convert the three-element tuple to an English description of the error, use
format_error/1.
The encoding of Filename can be set by a comment, as described in epp(3erl).
eval(Filename, Bindings) -> ok | {error, Reason}
Types:
Filename = name_all()
Bindings = erl_eval:binding_struct()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
The same as eval/1, but the variable bindings Bindings are used in the evaluation.
For information about the variable bindings, see erl_eval(3erl).
format_error(Reason) -> Chars
Types:
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
Chars = string()
Given the error reason returned by any function in this module, returns a
descriptive string of the error in English.
get_cwd() -> {ok, Dir} | {error, Reason}
Types:
Dir = filename()
Reason = posix()
Returns {ok, Dir}, where Dir is the current working directory of the file server.
Note:
In rare circumstances, this function can fail on Unix. It can occur if read
permission does not exist for the parent directories of the current directory.
A typical error reason:
eacces:
Missing read permission for one of the parents of the current directory.
get_cwd(Drive) -> {ok, Dir} | {error, Reason}
Types:
Drive = string()
Dir = filename()
Reason = posix() | badarg
Returns {ok, Dir} or {error, Reason}, where Dir is the current working directory of
the specified drive.
Drive is to be of the form "Letter:", for example, "c:".
Returns {error, enotsup} on platforms that have no concept of current drive (Unix,
for example).
Typical error reasons:
enotsup:
The operating system has no concept of drives.
eacces:
The drive does not exist.
einval:
The format of Drive is invalid.
list_dir(Dir) -> {ok, Filenames} | {error, Reason}
Types:
Dir = name_all()
Filenames = [filename()]
Reason =
posix() |
badarg |
{no_translation, Filename :: unicode:latin1_binary()}
Lists all files in a directory, except files with raw filenames. Returns {ok,
Filenames} if successful, otherwise {error, Reason}. Filenames is a list of the
names of all the files in the directory. The names are not sorted.
Typical error reasons:
eacces:
Missing search or write permissions for Dir or one of its parent directories.
enoent:
The directory does not exist.
{no_translation, Filename}:
Filename is a binary() with characters coded in ISO Latin-1 and the VM was
started with parameter +fnue.
list_dir_all(Dir) -> {ok, Filenames} | {error, Reason}
Types:
Dir = name_all()
Filenames = [filename_all()]
Reason = posix() | badarg
Lists all the files in a directory, including files with raw filenames. Returns
{ok, Filenames} if successful, otherwise {error, Reason}. Filenames is a list of
the names of all the files in the directory. The names are not sorted.
Typical error reasons:
eacces:
Missing search or write permissions for Dir or one of its parent directories.
enoent:
The directory does not exist.
make_dir(Dir) -> ok | {error, Reason}
Types:
Dir = name_all()
Reason = posix() | badarg
Tries to create directory Dir. Missing parent directories are not created. Returns
ok if successful.
Typical error reasons:
eacces:
Missing search or write permissions for the parent directories of Dir.
eexist:
A file or directory named Dir exists already.
enoent:
A component of Dir does not exist.
enospc:
No space is left on the device.
enotdir:
A component of Dir is not a directory. On some platforms, enoent is returned
instead.
make_link(Existing, New) -> ok | {error, Reason}
Types:
Existing = New = name_all()
Reason = posix() | badarg
Makes a hard link from Existing to New on platforms supporting links (Unix and
Windows). This function returns ok if the link was successfully created, otherwise
{error, Reason}. On platforms not supporting links, {error,enotsup} is returned.
Typical error reasons:
eacces:
Missing read or write permissions for the parent directories of Existing or
New.
eexist:
New already exists.
enotsup:
Hard links are not supported on this platform.
make_symlink(Existing, New) -> ok | {error, Reason}
Types:
Existing = New = name_all()
Reason = posix() | badarg
Creates a symbolic link New to the file or directory Existing on platforms
supporting symbolic links (most Unix systems and Windows, beginning with Vista).
Existing does not need to exist. Returns ok if the link is successfully created,
otherwise {error, Reason}. On platforms not supporting symbolic links, {error,
enotsup} is returned.
Typical error reasons:
eacces:
Missing read or write permissions for the parent directories of Existing or
New.
eexist:
New already exists.
enotsup:
Symbolic links are not supported on this platform.
eperm:
User does not have privileges to create symbolic links
(SeCreateSymbolicLinkPrivilege on Windows).
native_name_encoding() -> latin1 | utf8
Returns the filename encoding mode. If it is latin1, the system translates no
filenames. If it is utf8, filenames are converted back and forth to the native
filename encoding (usually UTF-8, but UTF-16 on Windows).
open(File, Modes) -> {ok, IoDevice} | {error, Reason}
Types:
File = Filename | iodata()
Filename = name_all()
Modes = [mode() | ram]
IoDevice = io_device()
Reason = posix() | badarg | system_limit
Opens file File in the mode determined by Modes, which can contain one or more of
the following options:
read:
The file, which must exist, is opened for reading.
write:
The file is opened for writing. It is created if it does not exist. If the file
exists and write is not combined with read, the file is truncated.
append:
The file is opened for writing. It is created if it does not exist. Every write
operation to a file opened with append takes place at the end of the file.
exclusive:
The file is opened for writing. It is created if it does not exist. If the file
exists, {error, eexist} is returned.
Warning:
This option does not guarantee exclusiveness on file systems not supporting
O_EXCL properly, such as NFS. Do not depend on this option unless you know that
the file system supports it (in general, local file systems are safe).
raw:
Allows faster access to a file, as no Erlang process is needed to handle the
file. However, a file opened in this way has the following limitations:
* The functions in the io module cannot be used, as they can only talk to an
Erlang process. Instead, use functions read/2, read_line/1, and write/2.
* Especially if read_line/1 is to be used on a raw file, it is recommended to
combine this option with option {read_ahead, Size} as line-oriented I/O is
inefficient without buffering.
* Only the Erlang process that opened the file can use it.
* A remote Erlang file server cannot be used. The computer on which the Erlang
node is running must have access to the file system (directly or through
NFS).
binary:
Read operations on the file return binaries rather than lists.
{delayed_write, Size, Delay}:
Data in subsequent write/2 calls is buffered until at least Size bytes are
buffered, or until the oldest buffered data is Delay milliseconds old. Then all
buffered data is written in one operating system call. The buffered data is
also flushed before some other file operation than write/2 is executed.
The purpose of this option is to increase performance by reducing the number of
operating system calls. Thus, the write/2 calls must be for sizes significantly
less than Size, and not interspersed by too many other file operations.
When this option is used, the result of write/2 calls can prematurely be
reported as successful, and if a write error occurs, the error is reported as
the result of the next file operation, which is not executed.
For example, when delayed_write is used, after a number of write/2 calls,
close/1 can return {error, enospc}, as there is not enough space on the disc
for previously written data. close/1 must probably be called again, as the file
is still open.
delayed_write:
The same as {delayed_write, Size, Delay} with reasonable default values for
Size and Delay (roughly some 64 KB, 2 seconds).
{read_ahead, Size}:
Activates read data buffering. If read/2 calls are for significantly less than
Size bytes, read operations to the operating system are still performed for
blocks of Size bytes. The extra data is buffered and returned in subsequent
read/2 calls, giving a performance gain as the number of operating system calls
is reduced.
The read_ahead buffer is also highly used by function read_line/1 in raw mode,
therefore this option is recommended (for performance reasons) when accessing
raw files using that function.
If read/2 calls are for sizes not significantly less than, or even greater than
Size bytes, no performance gain can be expected.
read_ahead:
The same as {read_ahead, Size} with a reasonable default value for Size
(roughly some 64 KB).
compressed:
Makes it possible to read or write gzip compressed files. Option compressed
must be combined with read or write, but not both. Notice that the file size
obtained with read_file_info/1 does probably not match the number of bytes that
can be read from a compressed file.
{encoding, Encoding}:
Makes the file perform automatic translation of characters to and from a
specific (Unicode) encoding. Notice that the data supplied to write/2 or
returned by read/2 still is byte-oriented; this option denotes only how data is
stored in the disk file.
Depending on the encoding, different methods of reading and writing data is
preferred. The default encoding of latin1 implies using this module (file) for
reading and writing data as the interfaces provided here work with byte-
oriented data. Using other (Unicode) encodings makes the io(3erl) functions
get_chars, get_line, and put_chars more suitable, as they can work with the
full Unicode range.
If data is sent to an io_device() in a format that cannot be converted to the
specified encoding, or if data is read by a function that returns data in a
format that cannot cope with the character range of the data, an error occurs
and the file is closed.
Allowed values for Encoding:
latin1:
The default encoding. Bytes supplied to the file, that is, write/2 are
written "as is" on the file. Likewise, bytes read from the file, that is,
read/2 are returned "as is". If module io(3erl) is used for writing, the file
can only cope with Unicode characters up to code point 255 (the ISO Latin-1
range).
unicode or utf8:
Characters are translated to and from UTF-8 encoding before they are written
to or read from the file. A file opened in this way can be readable using
function read/2, as long as no data stored on the file lies beyond the ISO
Latin-1 range (0..255), but failure occurs if the data contains Unicode code
points beyond that range. The file is best read with the functions in the
Unicode aware module io(3erl).
Bytes written to the file by any means are translated to UTF-8 encoding
before being stored on the disk file.
utf16 or {utf16,big}:
Works like unicode, but translation is done to and from big endian UTF-16
instead of UTF-8.
{utf16,little}:
Works like unicode, but translation is done to and from little endian UTF-16
instead of UTF-8.
utf32 or {utf32,big}:
Works like unicode, but translation is done to and from big endian UTF-32
instead of UTF-8.
{utf32,little}:
Works like unicode, but translation is done to and from little endian UTF-32
instead of UTF-8.
The Encoding can be changed for a file "on the fly" by using function
io:setopts/2. So a file can be analyzed in latin1 encoding for, for example, a
BOM, positioned beyond the BOM and then be set for the right encoding before
further reading. For functions identifying BOMs, see module unicode(3erl).
This option is not allowed on raw files.
ram:
File must be iodata(). Returns an fd(), which lets module file operate on the
data in-memory as if it is a file.
sync:
On platforms supporting it, enables the POSIX O_SYNC synchronous I/O flag or
its platform-dependent equivalent (for example, FILE_FLAG_WRITE_THROUGH on
Windows) so that writes to the file block until the data is physically written
to disk. However, be aware that the exact semantics of this flag differ from
platform to platform. For example, none of Linux or Windows guarantees that all
file metadata are also written before the call returns. For precise semantics,
check the details of your platform documentation. On platforms with no support
for POSIX O_SYNC or equivalent, use of the sync flag causes open to return
{error, enotsup}.
Returns:
{ok, IoDevice}:
The file is opened in the requested mode. IoDevice is a reference to the file.
{error, Reason}:
The file cannot be opened.
IoDevice is really the pid of the process that handles the file. This process is
linked to the process that originally opened the file. If any process to which the
IoDevice is linked terminates, the file is closed and the process itself is
terminated. An IoDevice returned from this call can be used as an argument to the
I/O functions (see io(3erl)).
Note:
In previous versions of file, modes were specified as one of the atoms read, write,
or read_write instead of a list. This is still allowed for reasons of backwards
compatibility, but is not to be used for new code. Also note that read_write is not
allowed in a mode list.
Typical error reasons:
enoent:
The file does not exist.
eacces:
Missing permission for reading the file or searching one of the parent
directories.
eisdir:
The named file is not a regular file. It can be a directory, a FIFO, or a
device.
enotdir:
A component of the filename is not a directory. On some platforms, enoent is
returned instead.
enospc:
There is no space left on the device (if write access was specified).
path_consult(Path, Filename) ->
{ok, Terms, FullName} | {error, Reason}
Types:
Path = [Dir]
Dir = Filename = name_all()
Terms = [term()]
FullName = filename_all()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
Searches the path Path (a list of directory names) until the file Filename is
found. If Filename is an absolute filename, Path is ignored. Then reads Erlang
terms, separated by '.', from the file.
Returns one of the following:
{ok, Terms, FullName}:
The file is successfully read. FullName is the full name of the file.
{error, enoent}:
The file cannot be found in any of the directories in Path.
{error, atom()}:
An error occurred when opening the file or reading it. For a list of typical
error codes, see open/2.
{error, {Line, Mod, Term}}:
An error occurred when interpreting the Erlang terms in the file. Use
format_error/1 to convert the three-element tuple to an English description of
the error.
The encoding of Filename can be set by a comment as described in epp(3erl).
path_eval(Path, Filename) -> {ok, FullName} | {error, Reason}
Types:
Path = [Dir :: name_all()]
Filename = name_all()
FullName = filename_all()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
Searches the path Path (a list of directory names) until the file Filename is
found. If Filename is an absolute filename, Path is ignored. Then reads and
evaluates Erlang expressions, separated by '.' (or ',', a sequence of expressions
is also an expression), from the file. The result of evaluation is not returned;
any expression sequence in the file must be there for its side effect.
Returns one of the following:
{ok, FullName}:
The file is read and evaluated. FullName is the full name of the file.
{error, enoent}:
The file cannot be found in any of the directories in Path.
{error, atom()}:
An error occurred when opening the file or reading it. For a list of typical
error codes, see open/2.
{error, {Line, Mod, Term}}:
An error occurred when interpreting the Erlang expressions in the file. Use
format_error/1 to convert the three-element tuple to an English description of
the error.
The encoding of Filename can be set by a comment as described in epp(3erl).
path_open(Path, Filename, Modes) ->
{ok, IoDevice, FullName} | {error, Reason}
Types:
Path = [Dir :: name_all()]
Filename = name_all()
Modes = [mode()]
IoDevice = io_device()
FullName = filename_all()
Reason = posix() | badarg | system_limit
Searches the path Path (a list of directory names) until the file Filename is
found. If Filename is an absolute filename, Path is ignored. Then opens the file in
the mode determined by Modes.
Returns one of the following:
{ok, IoDevice, FullName}:
The file is opened in the requested mode. IoDevice is a reference to the file
and FullName is the full name of the file.
{error, enoent}:
The file cannot be found in any of the directories in Path.
{error, atom()}:
The file cannot be opened.
path_script(Path, Filename) ->
{ok, Value, FullName} | {error, Reason}
Types:
Path = [Dir :: name_all()]
Filename = name_all()
Value = term()
FullName = filename_all()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
Searches the path Path (a list of directory names) until the file Filename is
found. If Filename is an absolute filename, Path is ignored. Then reads and
evaluates Erlang expressions, separated by '.' (or ',', a sequence of expressions
is also an expression), from the file.
Returns one of the following:
{ok, Value, FullName}:
The file is read and evaluated. FullName is the full name of the file and Value
the value of the last expression.
{error, enoent}:
The file cannot be found in any of the directories in Path.
{error, atom()}:
An error occurred when opening the file or reading it. For a list of typical
error codes, see open/2.
{error, {Line, Mod, Term}}:
An error occurred when interpreting the Erlang expressions in the file. Use
format_error/1 to convert the three-element tuple to an English description of
the error.
The encoding of Filename can be set by a comment as described in epp(3erl).
path_script(Path, Filename, Bindings) ->
{ok, Value, FullName} | {error, Reason}
Types:
Path = [Dir :: name_all()]
Filename = name_all()
Bindings = erl_eval:binding_struct()
Value = term()
FullName = filename_all()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
The same as path_script/2 but the variable bindings Bindings are used in the
evaluation. See erl_eval(3erl) about variable bindings.
pid2name(Pid) -> {ok, Filename} | undefined
Types:
Filename = filename_all()
Pid = pid()
If Pid is an I/O device, that is, a pid returned from open/2, this function returns
the filename, or rather:
{ok, Filename}:
If the file server of this node is not a slave, the file was opened by the file
server of this node (this implies that Pid must be a local pid) and the file is
not closed. Filename is the filename in flat string format.
undefined:
In all other cases.
Warning:
This function is intended for debugging only.
position(IoDevice, Location) ->
{ok, NewPosition} | {error, Reason}
Types:
IoDevice = io_device()
Location = location()
NewPosition = integer()
Reason = posix() | badarg | terminated
Sets the position of the file referenced by IoDevice to Location. Returns {ok,
NewPosition} (as absolute offset) if successful, otherwise {error, Reason}.
Location is one of the following:
Offset:
The same as {bof, Offset}.
{bof, Offset}:
Absolute offset.
{cur, Offset}:
Offset from the current position.
{eof, Offset}:
Offset from the end of file.
bof | cur | eof:
The same as above with Offset 0.
Notice that offsets are counted in bytes, not in characters. If the file is opened
using some other encoding than latin1, one byte does not correspond to one
character. Positioning in such a file can only be done to known character
boundaries. That is, to a position earlier retrieved by getting a current position,
to the beginning/end of the file or to some other position known to be on a correct
character boundary by some other means (typically beyond a byte order mark in the
file, which has a known byte-size).
A typical error reason is:
einval:
Either Location is illegal, or it is evaluated to a negative offset in the
file. Notice that if the resulting position is a negative value, the result is
an error, and after the call the file position is undefined.
pread(IoDevice, LocNums) -> {ok, DataL} | eof | {error, Reason}
Types:
IoDevice = io_device()
LocNums =
[{Location :: location(), Number :: integer() >= 0}]
DataL = [Data]
Data = string() | binary() | eof
Reason = posix() | badarg | terminated
Performs a sequence of pread/3 in one operation, which is more efficient than
calling them one at a time. Returns {ok, [Data, ...]} or {error, Reason}, where
each Data, the result of the corresponding pread, is either a list or a binary
depending on the mode of the file, or eof if the requested position is beyond end
of file.
As the position is specified as a byte-offset, take special caution when working
with files where encoding is set to something else than latin1, as not every byte
position is a valid character boundary on such a file.
pread(IoDevice, Location, Number) ->
{ok, Data} | eof | {error, Reason}
Types:
IoDevice = io_device()
Location = location()
Number = integer() >= 0
Data = string() | binary()
Reason = posix() | badarg | terminated
Combines position/2 and read/2 in one operation, which is more efficient than
calling them one at a time. If IoDevice is opened in raw mode, some restrictions
apply:
* Location is only allowed to be an integer.
* The current position of the file is undefined after the operation.
As the position is specified as a byte-offset, take special caution when working
with files where encoding is set to something else than latin1, as not every byte
position is a valid character boundary on such a file.
pwrite(IoDevice, LocBytes) -> ok | {error, {N, Reason}}
Types:
IoDevice = io_device()
LocBytes = [{Location :: location(), Bytes :: iodata()}]
N = integer() >= 0
Reason = posix() | badarg | terminated
Performs a sequence of pwrite/3 in one operation, which is more efficient than
calling them one at a time. Returns ok or {error, {N, Reason}}, where N is the
number of successful writes done before the failure.
When positioning in a file with other encoding than latin1, caution must be taken
to set the position on a correct character boundary. For details, see position/2.
pwrite(IoDevice, Location, Bytes) -> ok | {error, Reason}
Types:
IoDevice = io_device()
Location = location()
Bytes = iodata()
Reason = posix() | badarg | terminated
Combines position/2 and write/2 in one operation, which is more efficient than
calling them one at a time. If IoDevice has been opened in raw mode, some
restrictions apply:
* Location is only allowed to be an integer.
* The current position of the file is undefined after the operation.
When positioning in a file with other encoding than latin1, caution must be taken
to set the position on a correct character boundary. For details, see position/2.
read(IoDevice, Number) -> {ok, Data} | eof | {error, Reason}
Types:
IoDevice = io_device() | atom()
Number = integer() >= 0
Data = string() | binary()
Reason =
posix() |
badarg |
terminated |
{no_translation, unicode, latin1}
Reads Number bytes/characters from the file referenced by IoDevice. The functions
read/2, pread/3, and read_line/1 are the only ways to read from a file opened in
raw mode (although they work for normally opened files, too).
For files where encoding is set to something else than latin1, one character can be
represented by more than one byte on the file. The parameter Number always denotes
the number of characters read from the file, while the position in the file can be
moved much more than this number when reading a Unicode file.
Also, if encoding is set to something else than latin1, the read/3 call fails if
the data contains characters larger than 255, which is why module io(3erl) is to be
preferred when reading such a file.
The function returns:
{ok, Data}:
If the file was opened in binary mode, the read bytes are returned in a binary,
otherwise in a list. The list or binary is shorter than the number of bytes
requested if end of file was reached.
eof:
Returned if Number>0 and end of file was reached before anything at all could
be read.
{error, Reason}:
An error occurred.
Typical error reasons:
ebadf:
The file is not opened for reading.
{no_translation, unicode, latin1}:
The file is opened with another encoding than latin1 and the data in the file
cannot be translated to the byte-oriented data that this function returns.
read_file(Filename) -> {ok, Binary} | {error, Reason}
Types:
Filename = name_all()
Binary = binary()
Reason = posix() | badarg | terminated | system_limit
Returns {ok, Binary}, where Binary is a binary data object that contains the
contents of Filename, or {error, Reason} if an error occurs.
Typical error reasons:
enoent:
The file does not exist.
eacces:
Missing permission for reading the file, or for searching one of the parent
directories.
eisdir:
The named file is a directory.
enotdir:
A component of the filename is not a directory. On some platforms, enoent is
returned instead.
enomem:
There is not enough memory for the contents of the file.
read_file_info(Filename) -> {ok, FileInfo} | {error, Reason}
read_file_info(Filename, Opts) -> {ok, FileInfo} | {error, Reason}
Types:
Filename = name_all()
Opts = [file_info_option()]
FileInfo = file_info()
Reason = posix() | badarg
Retrieves information about a file. Returns {ok, FileInfo} if successful, otherwise
{error, Reason}. FileInfo is a record file_info, defined in the Kernel include file
file.hrl. Include the following directive in the module from which the function is
called:
-include_lib("kernel/include/file.hrl").
The time type returned in atime, mtime, and ctime is dependent on the time type set
in Opts :: {time, Type} as follows:
local:
Returns local time.
universal:
Returns universal time.
posix:
Returns seconds since or before Unix time epoch, which is 1970-01-01 00:00 UTC.
Default is {time, local}.
If the option raw is set, the file server is not called and only information about
local files is returned.
Note:
As file times are stored in POSIX time on most OS, it is faster to query file
information with option posix.
The record file_info contains the following fields:
size = integer() >= 0:
Size of file in bytes.
type = device | directory | other | regular | symlink:
The type of the file.
access = read | write | read_write | none:
The current system access to the file.
atime = date_time() | integer() >= 0:
The last time the file was read.
mtime = date_time() | integer() >= 0:
The last time the file was written.
ctime = date_time() | integer() >=0:
The interpretation of this time field depends on the operating system. On Unix,
it is the last time the file or the inode was changed. In Windows, it is the
create time.
mode = integer() >= 0:
The file permissions as the sum of the following bit values:
8#00400:
read permission: owner
8#00200:
write permission: owner
8#00100:
execute permission: owner
8#00040:
read permission: group
8#00020:
write permission: group
8#00010:
execute permission: group
8#00004:
read permission: other
8#00002:
write permission: other
8#00001:
execute permission: other
16#800:
set user id on execution
16#400:
set group id on execution
On Unix platforms, other bits than those listed above may be set.
links = integer() >= 0:
Number of links to the file (this is always 1 for file systems that have no
concept of links).
major_device = integer() >= 0:
Identifies the file system where the file is located. In Windows, the number
indicates a drive as follows: 0 means A:, 1 means B:, and so on.
minor_device = integer() >= 0:
Only valid for character devices on Unix. In all other cases, this field is
zero.
inode = integer() >= 0:
Gives the inode number. On non-Unix file systems, this field is zero.
uid = integer() >= 0:
Indicates the owner of the file. On non-Unix file systems, this field is zero.
gid = integer() >= 0:
Gives the group that the owner of the file belongs to. On non-Unix file
systems, this field is zero.
Typical error reasons:
eacces:
Missing search permission for one of the parent directories of the file.
enoent:
The file does not exist.
enotdir:
A component of the filename is not a directory. On some platforms, enoent is
returned instead.
read_line(IoDevice) -> {ok, Data} | eof | {error, Reason}
Types:
IoDevice = io_device() | atom()
Data = string() | binary()
Reason =
posix() |
badarg |
terminated |
{no_translation, unicode, latin1}
Reads a line of bytes/characters from the file referenced by IoDevice. Lines are
defined to be delimited by the linefeed (LF, \n) character, but any carriage return
(CR, \r) followed by a newline is also treated as a single LF character (the
carriage return is silently ignored). The line is returned including the LF, but
excluding any CR immediately followed by an LF. This behaviour is consistent with
the behaviour of io:get_line/2. If end of file is reached without any LF ending the
last line, a line with no trailing LF is returned.
The function can be used on files opened in raw mode. However, it is inefficient to
use it on raw files if the file is not opened with option {read_ahead, Size}
specified. Thus, combining raw and {read_ahead, Size} is highly recommended when
opening a text file for raw line-oriented reading.
If encoding is set to something else than latin1, the read_line/1 call fails if the
data contains characters larger than 255, why module io(3erl) is to be preferred
when reading such a file.
The function returns:
{ok, Data}:
One line from the file is returned, including the trailing LF, but with CRLF
sequences replaced by a single LF (see above).
If the file is opened in binary mode, the read bytes are returned in a binary,
otherwise in a list.
eof:
Returned if end of file was reached before anything at all could be read.
{error, Reason}:
An error occurred.
Typical error reasons:
ebadf:
The file is not opened for reading.
{no_translation, unicode, latin1}:
The file is opened with another encoding than latin1 and the data on the file
cannot be translated to the byte-oriented data that this function returns.
read_link(Name) -> {ok, Filename} | {error, Reason}
Types:
Name = name_all()
Filename = filename()
Reason = posix() | badarg
Returns {ok, Filename} if Name refers to a symbolic link that is not a raw
filename, or {error, Reason} otherwise. On platforms that do not support symbolic
links, the return value is {error,enotsup}.
Typical error reasons:
einval:
Name does not refer to a symbolic link or the name of the file that it refers
to does not conform to the expected encoding.
enoent:
The file does not exist.
enotsup:
Symbolic links are not supported on this platform.
read_link_all(Name) -> {ok, Filename} | {error, Reason}
Types:
Name = name_all()
Filename = filename_all()
Reason = posix() | badarg
Returns {ok, Filename} if Name refers to a symbolic link or {error, Reason}
otherwise. On platforms that do not support symbolic links, the return value is
{error,enotsup}.
Notice that Filename can be either a list or a binary.
Typical error reasons:
einval:
Name does not refer to a symbolic link.
enoent:
The file does not exist.
enotsup:
Symbolic links are not supported on this platform.
read_link_info(Name) -> {ok, FileInfo} | {error, Reason}
read_link_info(Name, Opts) -> {ok, FileInfo} | {error, Reason}
Types:
Name = name_all()
Opts = [file_info_option()]
FileInfo = file_info()
Reason = posix() | badarg
Works like read_file_info/1,2 except that if Name is a symbolic link, information
about the link is returned in the file_info record and the type field of the record
is set to symlink.
If the option raw is set, the file server is not called and only information about
local files is returned.
If Name is not a symbolic link, this function returns the same result as
read_file_info/1. On platforms that do not support symbolic links, this function is
always equivalent to read_file_info/1.
rename(Source, Destination) -> ok | {error, Reason}
Types:
Source = Destination = name_all()
Reason = posix() | badarg
Tries to rename the file Source to Destination. It can be used to move files (and
directories) between directories, but it is not sufficient to specify the
destination only. The destination filename must also be specified. For example, if
bar is a normal file and foo and baz are directories, rename("foo/bar", "baz")
returns an error, but rename("foo/bar", "baz/bar") succeeds. Returns ok if it is
successful.
Note:
Renaming of open files is not allowed on most platforms (see eacces below).
Typical error reasons:
eacces:
Missing read or write permissions for the parent directories of Source or
Destination. On some platforms, this error is given if either Source or
Destination is open.
eexist:
Destination is not an empty directory. On some platforms, also given when
Source and Destination are not of the same type.
einval:
Source is a root directory, or Destination is a subdirectory of Source.
eisdir:
Destination is a directory, but Source is not.
enoent:
Source does not exist.
enotdir:
Source is a directory, but Destination is not.
exdev:
Source and Destination are on different file systems.
script(Filename) -> {ok, Value} | {error, Reason}
Types:
Filename = name_all()
Value = term()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
Reads and evaluates Erlang expressions, separated by '.' (or ',', a sequence of
expressions is also an expression), from the file.
Returns one of the following:
{ok, Value}:
The file is read and evaluated. Value is the value of the last expression.
{error, atom()}:
An error occurred when opening the file or reading it. For a list of typical
error codes, see open/2.
{error, {Line, Mod, Term}}:
An error occurred when interpreting the Erlang expressions in the file. Use
format_error/1 to convert the three-element tuple to an English description of
the error.
The encoding of Filename can be set by a comment as described in epp(3erl).
script(Filename, Bindings) -> {ok, Value} | {error, Reason}
Types:
Filename = name_all()
Bindings = erl_eval:binding_struct()
Value = term()
Reason =
posix() |
badarg |
terminated |
system_limit |
{Line :: integer(), Mod :: module(), Term :: term()}
The same as script/1 but the variable bindings Bindings are used in the evaluation.
See erl_eval(3erl) about variable bindings.
sendfile(Filename, Socket) ->
{ok, integer() >= 0} |
{error, inet:posix() | closed | badarg | not_owner}
Types:
Filename = name_all()
Socket = inet:socket()
Sends the file Filename to Socket. Returns {ok, BytesSent} if successful, otherwise
{error, Reason}.
sendfile(RawFile, Socket, Offset, Bytes, Opts) ->
{ok, integer() >= 0} |
{error, inet:posix() | closed | badarg | not_owner}
Types:
RawFile = fd()
Socket = inet:socket()
Offset = Bytes = integer() >= 0
Opts = [sendfile_option()]
sendfile_option() =
{chunk_size, integer() >= 0} | {use_threads, boolean()}
Sends Bytes from the file referenced by RawFile beginning at Offset to Socket.
Returns {ok, BytesSent} if successful, otherwise {error, Reason}. If Bytes is set
to 0 all data after the specified Offset is sent.
The file used must be opened using the raw flag, and the process calling sendfile
must be the controlling process of the socket. See gen_tcp:controlling_process/2.
If the OS used does not support sendfile, an Erlang fallback using read/2 and
gen_tcp:send/2 is used.
The option list can contain the following options:
chunk_size:
The chunk size used by the Erlang fallback to send data. If using the fallback,
set this to a value that comfortably fits in the systems memory. Default is 20
MB.
use_threads:
Instructs the emulator to use the async thread pool for the sendfile system
call. This can be useful if the OS you are running on does not properly support
non-blocking sendfile calls. Notice that using async threads potentially makes
your system vulnerable to slow client attacks. If set to true and no async
threads are available, the sendfile call returns {error,einval}. Introduced in
Erlang/OTP 17.0. Default is false.
set_cwd(Dir) -> ok | {error, Reason}
Types:
Dir = name() | EncodedBinary
EncodedBinary = binary()
Reason = posix() | badarg | no_translation
Sets the current working directory of the file server to Dir. Returns ok if
successful.
The functions in the module file usually treat binaries as raw filenames, that is,
they are passed "as is" even when the encoding of the binary does not agree with
native_name_encoding(). However, this function expects binaries to be encoded
according to the value returned by native_name_encoding().
Typical error reasons are:
enoent:
The directory does not exist.
enotdir:
A component of Dir is not a directory. On some platforms, enoent is returned.
eacces:
Missing permission for the directory or one of its parents.
badarg:
Dir has an improper type, such as tuple.
no_translation:
Dir is a binary() with characters coded in ISO-latin-1 and the VM is operating
with unicode filename encoding.
Warning:
In a future release, a bad type for argument Dir will probably generate an
exception.
sync(IoDevice) -> ok | {error, Reason}
Types:
IoDevice = io_device()
Reason = posix() | badarg | terminated
Ensures that any buffers kept by the operating system (not by the Erlang runtime
system) are written to disk. On some platforms, this function might have no effect.
A typical error reason is:
enospc:
Not enough space left to write the file.
truncate(IoDevice) -> ok | {error, Reason}
Types:
IoDevice = io_device()
Reason = posix() | badarg | terminated
Truncates the file referenced by IoDevice at the current position. Returns ok if
successful, otherwise {error, Reason}.
write(IoDevice, Bytes) -> ok | {error, Reason}
Types:
IoDevice = io_device() | atom()
Bytes = iodata()
Reason = posix() | badarg | terminated
Writes Bytes to the file referenced by IoDevice. This function is the only way to
write to a file opened in raw mode (although it works for normally opened files
too). Returns ok if successful, and {error, Reason} otherwise.
If the file is opened with encoding set to something else than latin1, each byte
written can result in many bytes being written to the file, as the byte range
0..255 can represent anything between one and four bytes depending on value and UTF
encoding type.
Typical error reasons:
ebadf:
The file is not opened for writing.
enospc:
No space is left on the device.
write_file(Filename, Bytes) -> ok | {error, Reason}
Types:
Filename = name_all()
Bytes = iodata()
Reason = posix() | badarg | terminated | system_limit
Writes the contents of the iodata term Bytes to file Filename. The file is created
if it does not exist. If it exists, the previous contents are overwritten. Returns
ok if successful, otherwise {error, Reason}.
Typical error reasons:
enoent:
A component of the filename does not exist.
enotdir:
A component of the filename is not a directory. On some platforms, enoent is
returned instead.
enospc:
No space is left on the device.
eacces:
Missing permission for writing the file or searching one of the parent
directories.
eisdir:
The named file is a directory.
write_file(Filename, Bytes, Modes) -> ok | {error, Reason}
Types:
Filename = name_all()
Bytes = iodata()
Modes = [mode()]
Reason = posix() | badarg | terminated | system_limit
Same as write_file/2, but takes a third argument Modes, a list of possible modes,
see open/2. The mode flags binary and write are implicit, so they are not to be
used.
write_file_info(Filename, FileInfo) -> ok | {error, Reason}
write_file_info(Filename, FileInfo, Opts) -> ok | {error, Reason}
Types:
Filename = name_all()
Opts = [file_info_option()]
FileInfo = file_info()
Reason = posix() | badarg
Changes file information. Returns ok if successful, otherwise {error, Reason}.
FileInfo is a record file_info, defined in the Kernel include file file.hrl.
Include the following directive in the module from which the function is called:
-include_lib("kernel/include/file.hrl").
The time type set in atime, mtime, and ctime depends on the time type set in Opts
:: {time, Type} as follows:
local:
Interprets the time set as local.
universal:
Interprets it as universal time.
posix:
Must be seconds since or before Unix time epoch, which is 1970-01-01 00:00 UTC.
Default is {time, local}.
If the option raw is set, the file server is not called and only information about
local files is returned.
The following fields are used from the record, if they are specified:
atime = date_time() | integer() >= 0:
The last time the file was read.
mtime = date_time() | integer() >= 0:
The last time the file was written.
ctime = date_time() | integer() >= 0:
On Unix, any value specified for this field is ignored (the "ctime" for the
file is set to the current time). On Windows, this field is the new creation
time to set for the file.
mode = integer() >= 0:
The file permissions as the sum of the following bit values:
8#00400:
Read permission: owner
8#00200:
Write permission: owner
8#00100:
Execute permission: owner
8#00040:
Read permission: group
8#00020:
Write permission: group
8#00010:
Execute permission: group
8#00004:
Read permission: other
8#00002:
Write permission: other
8#00001:
Execute permission: other
16#800:
Set user id on execution
16#400:
Set group id on execution
On Unix platforms, other bits than those listed above may be set.
uid = integer() >= 0:
Indicates the file owner. Ignored for non-Unix file systems.
gid = integer() >= 0:
Gives the group that the file owner belongs to. Ignored for non-Unix file
systems.
Typical error reasons:
eacces:
Missing search permission for one of the parent directories of the file.
enoent:
The file does not exist.
enotdir:
A component of the filename is not a directory. On some platforms, enoent is
returned instead.
POSIX ERROR CODES
* eacces - Permission denied
* eagain - Resource temporarily unavailable
* ebadf - Bad file number
* ebusy - File busy
* edquot - Disk quota exceeded
* eexist - File already exists
* efault - Bad address in system call argument
* efbig - File too large
* eintr - Interrupted system call
* einval - Invalid argument
* eio - I/O error
* eisdir - Illegal operation on a directory
* eloop - Too many levels of symbolic links
* emfile - Too many open files
* emlink - Too many links
* enametoolong - Filename too long
* enfile - File table overflow
* enodev - No such device
* enoent - No such file or directory
* enomem - Not enough memory
* enospc - No space left on device
* enotblk - Block device required
* enotdir - Not a directory
* enotsup - Operation not supported
* enxio - No such device or address
* eperm - Not owner
* epipe - Broken pipe
* erofs - Read-only file system
* espipe - Invalid seek
* esrch - No such process
* estale - Stale remote file handle
* exdev - Cross-domain link
PERFORMANCE
Some operating system file operations, for example, a sync/1 or close/1 on a huge file,
can block their calling thread for seconds. If this affects the emulator main thread, the
response time is no longer in the order of milliseconds, depending on the definition of
"soft" in soft real-time system.
If the device driver thread pool is active, file operations are done through those threads
instead, so the emulator can go on executing Erlang processes. Unfortunately, the time for
serving a file operation increases because of the extra scheduling required from the
operating system.
If the device driver thread pool is disabled or of size 0, large file reads and writes are
segmented into many smaller, which enable the emulator to serve other processes during the
file operation. This has the same effect as when using the thread pool, but with larger
overhead. Other file operations, for example, sync/1 or close/1 on a huge file, still are
a problem.
For increased performance, raw files are recommended. Raw files use the file system of the
host machine of the node.
Note:
For normal files (non-raw), the file server is used to find the files, and if the node is
running its file server as slave to the file server of another node, and the other node
runs on some other host machine, they can have different file systems. However, this is
seldom a problem.
A normal file is really a process so it can be used as an I/O device (see io). Therefore,
when data is written to a normal file, the sending of the data to the file process, copies
all data that are not binaries. Opening the file in binary mode and writing binaries is
therefore recommended. If the file is opened on another node, or if the file server runs
as slave to the file server of another node, also binaries are copied.
Caching data to reduce the number of file operations, or rather the number of calls to the
file driver, generally increases performance. The following function writes 4 MBytes in 23
seconds when tested:
create_file_slow(Name, N) when integer(N), N >= 0 ->
{ok, FD} = file:open(Name, [raw, write, delayed_write, binary]),
ok = create_file_slow(FD, 0, N),
ok = ?FILE_MODULE:close(FD),
ok.
create_file_slow(FD, M, M) ->
ok;
create_file_slow(FD, M, N) ->
ok = file:write(FD, <<M:32/unsigned>>),
create_file_slow(FD, M+1, N).
The following, functionally equivalent, function collects 1024 entries into a list of 128
32-byte binaries before each call to write/2 and so does the same work in 0.52 seconds,
which is 44 times faster:
create_file(Name, N) when integer(N), N >= 0 ->
{ok, FD} = file:open(Name, [raw, write, delayed_write, binary]),
ok = create_file(FD, 0, N),
ok = ?FILE_MODULE:close(FD),
ok.
create_file(FD, M, M) ->
ok;
create_file(FD, M, N) when M + 1024 =< N ->
create_file(FD, M, M + 1024, []),
create_file(FD, M + 1024, N);
create_file(FD, M, N) ->
create_file(FD, M, N, []).
create_file(FD, M, M, R) ->
ok = file:write(FD, R);
create_file(FD, M, N0, R) when M + 8 =< N0 ->
N1 = N0-1, N2 = N0-2, N3 = N0-3, N4 = N0-4,
N5 = N0-5, N6 = N0-6, N7 = N0-7, N8 = N0-8,
create_file(FD, M, N8,
[<<N8:32/unsigned, N7:32/unsigned,
N6:32/unsigned, N5:32/unsigned,
N4:32/unsigned, N3:32/unsigned,
N2:32/unsigned, N1:32/unsigned>> | R]);
create_file(FD, M, N0, R) ->
N1 = N0-1,
create_file(FD, M, N1, [<<N1:32/unsigned>> | R]).
Note:
Trust only your own benchmarks. If the list length in create_file/2 above is increased, it
runs slightly faster, but consumes more memory and causes more memory fragmentation. How
much this affects your application is something that this simple benchmark cannot predict.
If the size of each binary is increased to 64 bytes, it also runs slightly faster, but the
code is then twice as clumsy. In the current implementation, binaries larger than 64 bytes
are stored in memory common to all processes and not copied when sent between processes,
while these smaller binaries are stored on the process heap and copied when sent like any
other term.
So, with a binary size of 68 bytes, create_file/2 runs 30 percent slower than with 64
bytes, and causes much more memory fragmentation. Notice that if the binaries were to be
sent between processes (for example, a non-raw file), the results would probably be
completely different.
A raw file is really a port. When writing data to a port, it is efficient to write a list
of binaries. It is not needed to flatten a deep list before writing. On Unix hosts,
scatter output, which writes a set of buffers in one operation, is used when possible. In
this way write(FD, [Bin1, Bin2 | Bin3]) writes the contents of the binaries without
copying the data at all, except for perhaps deep down in the operating system kernel.
For raw files, pwrite/2 and pread/2 are efficiently implemented. The file driver is called
only once for the whole operation, and the list iteration is done in the file driver.
The options delayed_write and read_ahead to open/2 make the file driver cache data to
reduce the number of operating system calls. The function create_file/2 in the recent
example takes 60 seconds without option delayed_write, which is 2.6 times slower.
As a bad example, create_file_slow/2 without options raw, binary, and delayed_write,
meaning it calls open(Name, [write]), needs 1 min 20 seconds for the job, which is 3.5
times slower than the first example, and 150 times slower than the optimized
create_file/2.
Warning:
If an error occurs when accessing an open file with module io, the process handling the
file exits. The dead file process can hang if a process tries to access it later. This
will be fixed in a future release.
SEE ALSO
filename(3erl)