17.02.2013 Views

achadoop

achadoop

achadoop

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

mapred.job.tracker<br />

xxx.unx.sas.com:8021<br />

<br />

<br />

;;;;<br />

filename foo hadoop '/user/xxxx/acctdata.dat' cfg=cfg user='xxxx'<br />

pass='xxxx' debug recfm=s lrecl=65536 bufferlen=65536;<br />

data _null_;<br />

infile foo truncover;<br />

input a $1024.;<br />

put a;<br />

run;<br />

Example 3: Buffering 1MB of Data during a File Read<br />

This example uses the BUFFERLEN option to buffer 1MB of data at time during the file<br />

read. The records of length 1024 are read from this buffer.<br />

filename foo hadoop 'file1.dat' cfg='U=/hadoopcfg.xml'<br />

user='user' pass='apass' recfm=s<br />

lrecl=1024 bufferlen=1000000;<br />

data _null_;<br />

infile foo truncover;<br />

input a $1024.;<br />

put a;<br />

run;<br />

Example 4: Using the CONCAT Option<br />

This example uses the CONCAT option to read all members of DIRECTORY1 as if they<br />

are one file.<br />

filename foo hadoop '/directory1/' cfg='U=/hadoopcfg.xml'<br />

user='user' pass='apass' recfm=s lrecl=1024 concat;<br />

data _null_;<br />

infile foo truncover;<br />

input a $1024.;<br />

put a;<br />

run;<br />

See Also<br />

Statements<br />

• FILENAME Statement in the SAS Statements: Reference<br />

FILENAME Statement, Hadoop Access Method 35<br />

• FILENAME Statement, CATALOG Access Method in the SAS Statements:<br />

Reference<br />

• FILENAME Statement, EMAIL (SMTP) Access Method in the SAS Statements:<br />

Reference<br />

• FILENAME Statement, FTP Access Method in the SAS Statements: Reference

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!