Custom Pytorch Dataset Class for Timeseries Sequence Windows
Recently I was working on a problem with Time Series. Time Series can quickly add up to a lot of data, as you are using previous...
top of page
The Feed
Jun 23, 20202 min read
Finding the ideal num_workers for Pytorch Dataloaders
One of the biggest bottlenecks in Deep Learning is loading data. having fast drives and access to the data is important, especially if...
Mar 18, 20181 min read
Basic HBase Java Classes and Methods – Part 8: Disable and Delete a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 18, 20182 min read
Basic HBase Java Classes and Methods – Part 7: Delete from a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 12, 20183 min read
Basic HBase Java Classes and Methods – Part 6: Scan a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.Cell; import org.apache.hadoop.hbase.CellUtil; import...
Mar 12, 20182 min read
Basic HBase Java Classes and Methods – Part 5: Getting Data from a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 12, 20180 min read
Mar 11, 20183 min read
Basic HBase Java Classes and Methods – Part 4: Putting Data into a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 11, 20183 min read
Basic HBase Java Classes and Methods – Part 3: Table Creation
<?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-ins...
Mar 8, 20184 min read
Basic HBase Java Classes and Methods – Part 2: HBase Shell
Brian-Feenys-Mac-Pro:hbase-1.2.6 bfeeny$ hbase shell 2018-03-07 20:37:42,618 WARN util.NativeCodeLoader: Unable to load native-hadoop...
Mar 4, 20184 min read
Basic HBase Java Classes and Methods - Part 1: Getting Started
Brian-Feenys-Mac-Pro:hbase bfeeny$ mkdir hadoop Brian-Feenys-Mac-Pro:hbase bfeeny$ cd hadoop Brian-Feenys-Mac-Pro:hadoop bfeeny$ mv...
Feb 15, 20181 min read
Downgrading Apache Hadoop YARN to MapReduce v1
# remove YARN configuration sudo yum remove hadoop-conf-pseudo # stop YARN sudo service hadoop-yarn-resourcemanager stop sudo service...
Feb 10, 20181 min read
Scaling data for Deep Learning
from sklearn.preprocessing import MinMaxScaler scaler = MinMaxScaler() scaler.fit(train_data) train_data = scaler.transform(train_data)...
Jul 4, 20162 min read
Hacking NX-OS Part 3
PATH not properly set in shell scripts Input not properly sanity checked in scripts IFS together with PATH exploitable gdbserver running...
Jul 4, 20162 min read
Hacking NX-OS Part 2
this ;bash vi and then just use :shell from within vi........this gives you a shell, you can look around and do whatever you like. When...
bottom of page