achadoop

34 Chapter 3 • FILENAME, Hadoop Access Method
F
V
is fixed-record format. In this format, records have fixed lengths, and they are
read in binary mode.
is variable-record format (the default). In this format, records have varying
lengths, and they are read in text (stream) mode.
Tip: Any record larger than LRECL is truncated.
Default: V
USER='username'
where username is used to log on to the Hadoop system.
Requirement: The user name is case sensitive and it must be enclosed in single or
double quotation marks.
Details
An HDFS system has defined levels of permissions at both the directory and file level.
The Hadoop access method honors those permissions. For example, if a file is available
as read-only, you cannot modify it.
Operating Environment Information
Using the FILENAME statement requires information that is specific to your
operating environment. The Hadoop access method is fully documented here. For
more information about how to specify filenames, see the SAS documentation for
your operating environment.
Examples
Example 1: Writing to a New Member of a Directory
This example writes the file shoes to the directory testing.
filename out hadoop '/user/testing/' cfg=”/path/cfg.xml” user='xxxx'
pass='xxxx' recfm=v lrecl=32167 dir ;
data _null_;
file out(shoes) ;
put 'write data to shoes file';
run;
Example 2: Creating and Using a Configuration File
This example accesses the file acctdata.dat at site xxx.unx.sas.com. The
configuration file is accessed from the “cfg” fileref assignment.
filename cfg 'U:/test.cfg';
data _null_;
file cfg;
input;
put _infile_;
datalines4;
fs.default.name
hdfs://xxx.unx.sas.com:8020