File-system interface, ram_fs, libc-fs
This patch introduces the file-system-session interface, provides an
implementation of this interface in the form of an in-memory file
system, and enables the libc to use the new file-system facility.
The new interface resides in 'os/include/file_system_session/'. It
uses synchronous RPC calls for functions referring to directory
and meta-data handling. For transferring payload from/to files, the
packet-stream interface is used. I envision that the asynchronous design
of the packet-stream interface fits well will the block-session
interface. Compared to Unix-like file-system APIs, Genode's file-system
session interface is much simpler. In particular, it does not support
per-file permissions. On Genode, we facilitate binding policy (such as
write-permission) is sessions rather than individual file objects.
As a reference implementation of the new interface, there is the
new 'ram_fs' service at 'os/src/server/ram_fs'. It stores sparse
files in memory. At the startup, 'ram_fs' is able to populate the
file-system content with directories and ROM modules as specified
in its configuration.
To enable libc-using programs to access the new file-system interface,
there is the new libc plugin at 'libports/src/lib/libc-fs'. Using this
plugin, files stored on a native Genode file system can be accessed
using the traditional POSIX file API.
To see how the three parts described above fit together, the test
case at 'libports/run/libc_fs' can be taken as reference. It reuses
the original 'libc_ffat' test to exercise several file operations
on a RAM file-system using the libc API.
:Known limitations:
The current state should be regarded as work in progress. In particular
the error handling is not complete yet. Not all of the session functions
return the proper exceptions in the event of an error. I plan to
successively refine the interface while advancing the file-system
implementations. Also the support for truncating files and symlink
handling are not yet implemented.
Furthermore, there is much room for optimization, in particular for the
handling of directory entries. Currently, we communicate only one dir
entry at a time, which is bad when traversing large trees. However, I
decided to focus on functionality first and defer optimizations (such as
batching dir entries) to a later stage.
The current implementation does not handle file modification times at
all, which may be a severe limitation for tools that depend on this
information such as GNU make. Support for time will be added after we
have revisited Genode's timer-session interface (issue #1).
Fixes #54
Fixes #171
2012-04-11 15:46:33 +02:00
|
|
|
/*
|
|
|
|
* \brief Unit test for RAM fs chunk data structure
|
|
|
|
* \author Norman Feske
|
|
|
|
* \date 2012-04-19
|
|
|
|
*/
|
|
|
|
|
|
|
|
/* Genode includes */
|
|
|
|
#include <base/env.h>
|
|
|
|
#include <base/printf.h>
|
|
|
|
|
|
|
|
/* local 'ram_fs' include */
|
|
|
|
#include <chunk.h>
|
|
|
|
|
|
|
|
namespace File_system {
|
|
|
|
typedef Chunk<2> Chunk_level_3;
|
|
|
|
typedef Chunk_index<3, Chunk_level_3> Chunk_level_2;
|
|
|
|
typedef Chunk_index<4, Chunk_level_2> Chunk_level_1;
|
|
|
|
typedef Chunk_index<5, Chunk_level_1> Chunk_level_0;
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
namespace Genode {
|
|
|
|
|
|
|
|
struct Allocator_tracer : Allocator
|
|
|
|
{
|
|
|
|
size_t _sum;
|
|
|
|
Allocator &_wrapped;
|
|
|
|
|
|
|
|
Allocator_tracer(Allocator &wrapped) : _sum(0), _wrapped(wrapped) { }
|
|
|
|
|
|
|
|
size_t sum() const { return _sum; }
|
|
|
|
|
|
|
|
bool alloc(size_t size, void **out_addr)
|
|
|
|
{
|
|
|
|
_sum += size;
|
|
|
|
return _wrapped.alloc(size, out_addr);
|
|
|
|
}
|
|
|
|
|
|
|
|
void free(void *addr, size_t size)
|
|
|
|
{
|
|
|
|
_sum -= size;
|
|
|
|
_wrapped.free(addr, size);
|
|
|
|
}
|
|
|
|
|
2014-01-23 09:41:51 +01:00
|
|
|
size_t overhead(size_t size) override { return _wrapped.overhead(size); }
|
|
|
|
bool need_size_for_free() const override { return _wrapped.need_size_for_free(); }
|
File-system interface, ram_fs, libc-fs
This patch introduces the file-system-session interface, provides an
implementation of this interface in the form of an in-memory file
system, and enables the libc to use the new file-system facility.
The new interface resides in 'os/include/file_system_session/'. It
uses synchronous RPC calls for functions referring to directory
and meta-data handling. For transferring payload from/to files, the
packet-stream interface is used. I envision that the asynchronous design
of the packet-stream interface fits well will the block-session
interface. Compared to Unix-like file-system APIs, Genode's file-system
session interface is much simpler. In particular, it does not support
per-file permissions. On Genode, we facilitate binding policy (such as
write-permission) is sessions rather than individual file objects.
As a reference implementation of the new interface, there is the
new 'ram_fs' service at 'os/src/server/ram_fs'. It stores sparse
files in memory. At the startup, 'ram_fs' is able to populate the
file-system content with directories and ROM modules as specified
in its configuration.
To enable libc-using programs to access the new file-system interface,
there is the new libc plugin at 'libports/src/lib/libc-fs'. Using this
plugin, files stored on a native Genode file system can be accessed
using the traditional POSIX file API.
To see how the three parts described above fit together, the test
case at 'libports/run/libc_fs' can be taken as reference. It reuses
the original 'libc_ffat' test to exercise several file operations
on a RAM file-system using the libc API.
:Known limitations:
The current state should be regarded as work in progress. In particular
the error handling is not complete yet. Not all of the session functions
return the proper exceptions in the event of an error. I plan to
successively refine the interface while advancing the file-system
implementations. Also the support for truncating files and symlink
handling are not yet implemented.
Furthermore, there is much room for optimization, in particular for the
handling of directory entries. Currently, we communicate only one dir
entry at a time, which is bad when traversing large trees. However, I
decided to focus on functionality first and defer optimizations (such as
batching dir entries) to a later stage.
The current implementation does not handle file modification times at
all, which may be a severe limitation for tools that depend on this
information such as GNU make. Support for time will be added after we
have revisited Genode's timer-session interface (issue #1).
Fixes #54
Fixes #171
2012-04-11 15:46:33 +02:00
|
|
|
};
|
|
|
|
};
|
|
|
|
|
|
|
|
|
|
|
|
static void dump(File_system::Chunk_level_0 &chunk)
|
|
|
|
{
|
|
|
|
using namespace File_system;
|
|
|
|
|
|
|
|
static char read_buf[Chunk_level_0::SIZE];
|
|
|
|
|
|
|
|
size_t used_size = chunk.used_size();
|
|
|
|
|
|
|
|
struct File_size_out_of_bounds { };
|
|
|
|
if (used_size > Chunk_level_0::SIZE)
|
|
|
|
throw File_size_out_of_bounds();
|
|
|
|
|
|
|
|
chunk.read(read_buf, used_size, 0);
|
|
|
|
|
|
|
|
printf("content (size=%zd): \"", used_size);
|
|
|
|
for (unsigned i = 0; i < used_size; i++) {
|
|
|
|
char c = read_buf[i];
|
|
|
|
if (c)
|
|
|
|
printf("%c", c);
|
|
|
|
else
|
|
|
|
printf(".");
|
|
|
|
}
|
|
|
|
printf("\"\n");
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
static void write(File_system::Chunk_level_0 &chunk,
|
|
|
|
char const *str, Genode::off_t seek_offset)
|
|
|
|
{
|
|
|
|
using namespace Genode;
|
|
|
|
printf("write \"%s\" at offset %ld -> ", str, seek_offset);
|
|
|
|
chunk.write(str, strlen(str), seek_offset);
|
|
|
|
dump(chunk);
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
static void truncate(File_system::Chunk_level_0 &chunk,
|
|
|
|
File_system::file_size_t size)
|
|
|
|
{
|
|
|
|
using namespace Genode;
|
|
|
|
printf("trunc(%zd) -> ", (size_t)size);
|
|
|
|
chunk.truncate(size);
|
|
|
|
dump(chunk);
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
int main(int, char **)
|
|
|
|
{
|
|
|
|
using namespace File_system;
|
|
|
|
using namespace Genode;
|
|
|
|
|
|
|
|
printf("--- ram_fs_chunk test ---\n");
|
|
|
|
|
|
|
|
PINF("chunk sizes");
|
2012-06-07 09:35:22 +02:00
|
|
|
PINF(" level 0: payload=%d sizeof=%zd", Chunk_level_0::SIZE, sizeof(Chunk_level_0));
|
|
|
|
PINF(" level 1: payload=%d sizeof=%zd", Chunk_level_1::SIZE, sizeof(Chunk_level_1));
|
|
|
|
PINF(" level 2: payload=%d sizeof=%zd", Chunk_level_2::SIZE, sizeof(Chunk_level_2));
|
|
|
|
PINF(" level 3: payload=%d sizeof=%zd", Chunk_level_3::SIZE, sizeof(Chunk_level_3));
|
File-system interface, ram_fs, libc-fs
This patch introduces the file-system-session interface, provides an
implementation of this interface in the form of an in-memory file
system, and enables the libc to use the new file-system facility.
The new interface resides in 'os/include/file_system_session/'. It
uses synchronous RPC calls for functions referring to directory
and meta-data handling. For transferring payload from/to files, the
packet-stream interface is used. I envision that the asynchronous design
of the packet-stream interface fits well will the block-session
interface. Compared to Unix-like file-system APIs, Genode's file-system
session interface is much simpler. In particular, it does not support
per-file permissions. On Genode, we facilitate binding policy (such as
write-permission) is sessions rather than individual file objects.
As a reference implementation of the new interface, there is the
new 'ram_fs' service at 'os/src/server/ram_fs'. It stores sparse
files in memory. At the startup, 'ram_fs' is able to populate the
file-system content with directories and ROM modules as specified
in its configuration.
To enable libc-using programs to access the new file-system interface,
there is the new libc plugin at 'libports/src/lib/libc-fs'. Using this
plugin, files stored on a native Genode file system can be accessed
using the traditional POSIX file API.
To see how the three parts described above fit together, the test
case at 'libports/run/libc_fs' can be taken as reference. It reuses
the original 'libc_ffat' test to exercise several file operations
on a RAM file-system using the libc API.
:Known limitations:
The current state should be regarded as work in progress. In particular
the error handling is not complete yet. Not all of the session functions
return the proper exceptions in the event of an error. I plan to
successively refine the interface while advancing the file-system
implementations. Also the support for truncating files and symlink
handling are not yet implemented.
Furthermore, there is much room for optimization, in particular for the
handling of directory entries. Currently, we communicate only one dir
entry at a time, which is bad when traversing large trees. However, I
decided to focus on functionality first and defer optimizations (such as
batching dir entries) to a later stage.
The current implementation does not handle file modification times at
all, which may be a severe limitation for tools that depend on this
information such as GNU make. Support for time will be added after we
have revisited Genode's timer-session interface (issue #1).
Fixes #54
Fixes #171
2012-04-11 15:46:33 +02:00
|
|
|
|
|
|
|
static Allocator_tracer alloc(*env()->heap());
|
|
|
|
|
|
|
|
{
|
|
|
|
Chunk_level_0 chunk(alloc, 0);
|
|
|
|
|
|
|
|
write(chunk, "five-o-one", 0);
|
|
|
|
|
|
|
|
/* overwrite part of the file */
|
|
|
|
write(chunk, "five", 7);
|
|
|
|
|
|
|
|
/* write to position beyond current file length */
|
|
|
|
write(chunk, "Nuance", 17);
|
|
|
|
write(chunk, "YM-2149", 35);
|
|
|
|
|
|
|
|
truncate(chunk, 30);
|
|
|
|
|
|
|
|
for (unsigned i = 29; i > 0; i--)
|
|
|
|
truncate(chunk, i);
|
|
|
|
}
|
|
|
|
|
|
|
|
printf("allocator: sum=%zd\n", alloc.sum());
|
|
|
|
|
|
|
|
return 0;
|
|
|
|
}
|