Setting Up Hortonworks Data Platform (HDP) 2.6.5 Docker Container
Mohamad's interest is in Programming (Mobile, Web, Database and Machine Learning). He is studying at the Center For Artificial Intelligence Technology (CAIT), Universiti Kebangsaan Malaysia (UKM).
[1] Install Docker
https://desktop.docker.com/win/main/amd64/145265/Docker%20Desktop%20Installer.exe (V.4.29.0)
[2] Install Git Bash For Windows
(you need Git Bash to run container deployment codes)
https://github.com/git-for-windows/git/releases/download/v2.47.0.windows.2/Git-2.47.0.2-64-bit.exe
[3] Pull Hortonworks Data Platform (HDP) 2.6.5 image
Using Git Bash, run the following command:
docker pull hortonworks/sandbox-hdp:2.6.5
[4] Download deployment script
Download from
https://archive.cloudera.com/hwx-sandbox/hdp/hdp-2.6.5/HDP_2.6.5_deploy-scripts_180624d542a25.zip
Unzip to a deployment folder e.g. C:\users\user\myhorton

[5] Run deployment
Using Git Bash, run the following command:
bash ./docker-deploy-hdp265.sh
Full consol command and output as follows:
User@MSI MINGW64 ~/myhorton
$ bash ./docker-deploy-hdp265.sh
+ registry=hortonworks
+ name=sandbox-hdp
+ version=2.6.5
+ proxyName=sandbox-proxy
+ proxyVersion=1.0
+ flavor=hdp
+ echo hdp
+ mkdir -p sandbox/proxy/conf.d
+ mkdir -p sandbox/proxy/conf.stream.d
+ docker pull hortonworks/sandbox-hdp:2.6.5
2.6.5: Pulling from hortonworks/sandbox-hdp
Digest: sha256:0b34fa5cb197717828d6ffe547c23ad9b1c09f3b953e570e37f6f09809fbf3ba
Status: Image is up to date for hortonworks/sandbox-hdp:2.6.5
docker.io/hortonworks/sandbox-hdp:2.6.5
What's next:
View a summary of image vulnerabilities and recommendations → docker scout quickview hortonworks/sandbox-hdp:2.6.5
+ docker pull hortonworks/sandbox-proxy:1.0
1.0: Pulling from hortonworks/sandbox-proxy
Digest: sha256:42e4cfbcbb76af07e5d8f47a183a0d4105e65a1e7ef39fe37ab746e8b2523e9e
Status: Image is up to date for hortonworks/sandbox-proxy:1.0
docker.io/hortonworks/sandbox-proxy:1.0
What's next:
View a summary of image vulnerabilities and recommendations → docker scout quickview hortonworks/sandbox-proxy:1.0
+ '[' hdp == hdf ']'
+ '[' hdp == hdp ']'
+ hostname=sandbox-hdp.hortonworks.com
++ docker images
++ grep hortonworks/sandbox-hdp
++ awk '{print $2}'
+ version=2.6.5
+ docker network create cda
+ docker run --privileged --name sandbox-hdp -h sandbox-hdp.hortonworks.com --network=cda --network-alias=sandbox-hdp.hortonworks.com -d hortonworks/sandbox-hdp:2.6.5
aec5a8340cd1996c63c6b517f52d8237e92ed8f0a4793b35a1f28faaae74700f
+ echo ' Remove existing postgres run files. Please wait'
Remove existing postgres run files. Please wait
+ sleep 2
+ docker exec -t sandbox-hdp sh -c 'rm -rf /var/run/postgresql/*; systemctl restart postgresql;'
+ sed s/sandbox-hdp-security/sandbox-hdp/g assets/generate-proxy-deploy-script.sh
+ mv -f assets/generate-proxy-deploy-script.sh.new assets/generate-proxy-deploy-script.sh
+ chmod +x assets/generate-proxy-deploy-script.sh
+ assets/generate-proxy-deploy-script.sh
+ uname
+ grep MINGW
MINGW64_NT-10.0-22631
+ sed -i -e 's/\( \/[a-z]\)/\U\1:/g' sandbox/proxy/proxy-deploy.sh
+ chmod +x sandbox/proxy/proxy-deploy.sh
+ sandbox/proxy/proxy-deploy.sh
98485e801b909cd1f1977d9a39e34d33df456a98db8cef8719f2c072bac8a04f
User@MSI MINGW64 ~/myhorton
[6] Check Container List in Docker Desktop

[7] Browse dashboard page

Enter username/password=maria_dev/maria_dev

[8] Browse Files via Docker Desktop

[9] Browse Files via Web browser
http://localhost:50070/explorer.html#/user/maria_dev
