Custom Pytorch Dataset Class for Timeseries Sequence Windows
Recently I was working on a problem with Time Series. Â Time Series can quickly add up to a lot of data, as you are using previous...
top of page
The Feed
Jun 23, 20202 min read
Finding the ideal num_workers for Pytorch Dataloaders
One of the biggest bottlenecks in Deep Learning is loading data. Â having fast drives and access to the data is important, especially if...
Mar 18, 20181 min read
Basic HBase Java Classes and Methods – Part 8: Disable and Delete a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 18, 20182 min read
Basic HBase Java Classes and Methods – Part 7: Delete from a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 12, 20183 min read
Basic HBase Java Classes and Methods – Part 6: Scan a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.Cell; import org.apache.hadoop.hbase.CellUtil; import...
Mar 12, 20182 min read
Basic HBase Java Classes and Methods – Part 5: Getting Data from a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 12, 20180 min read
Mar 11, 20183 min read
Basic HBase Java Classes and Methods – Part 4: Putting Data into a Table
import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.TableName;...
Mar 11, 20183 min read
Basic HBase Java Classes and Methods – Part 3: Table Creation
<?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-ins...
Mar 8, 20184 min read
Basic HBase Java Classes and Methods – Part 2: HBase Shell
Brian-Feenys-Mac-Pro:hbase-1.2.6 bfeeny$ hbase shell 2018-03-07 20:37:42,618 WARN util.NativeCodeLoader: Unable to load native-hadoop...
Mar 4, 20184 min read
Basic HBase Java Classes and Methods - Part 1: Getting Started
Brian-Feenys-Mac-Pro:hbase bfeeny$ mkdir hadoop Brian-Feenys-Mac-Pro:hbase bfeeny$ cd hadoop Brian-Feenys-Mac-Pro:hadoop bfeeny$ mv...
Feb 15, 20181 min read
Downgrading Apache Hadoop YARN to MapReduce v1
# remove YARN configuration sudo yum remove hadoop-conf-pseudo # stop YARN sudo service hadoop-yarn-resourcemanager stop sudo service...
Feb 10, 20181 min read
Scaling data for Deep Learning
from sklearn.preprocessing import MinMaxScaler scaler = MinMaxScaler() scaler.fit(train_data) train_data = scaler.transform(train_data)...
Jul 4, 20162 min read
Hacking NX-OS Part 3
PATH not properly set in shell scripts Input not properly sanity checked in scripts IFS together with PATH exploitable gdbserver running...
Jul 4, 20162 min read
Hacking NX-OS Part 2
this ;bash vi and then just use :shell from within vi........this gives you a shell, you can look around and do whatever you like. When...
bottom of page