docker quick start for kafka

pre requisite: Install docker and docker-compose

Follow the steps as show in confluent document

https://docs.confluent.io/current/quickstart/ce-docker-quickstart.html

docker-compose up -d

Starting zookeeper …
Starting zookeeper … done
Starting broker …
Starting broker … done
Starting schema-registry …
Starting schema-registry … done
Starting rest-proxy …
Starting connect …
Starting connect
Starting connect … done
Starting ksqldb-server …
Starting ksqldb-server … done
Starting ksql-datagen …
Starting ksqldb-cli …
Starting ksqldb-cli
Starting control-center …
Starting ksql-datagen
Starting ksql-datagen … done

docker-compose ps

Go to Browser and open control-center

http://localhost:9021/clusters

Login to control-center container:

docker exec -it control-center bash
root@control-center:/# free -h
total used free shared buffers cached
Mem: 7.5G 6.0G 1.5G 410M 73M 1.1G
-/+ buffers/cache: 4.8G 2.6G
Swap: 2.0G 1.4G 623M
root@control-center:/# df -h
Filesystem Size Used Avail Use% Mounted on
overlay 458G 44G 391G 11% /
tmpfs 64M 0 64M 0% /dev
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/sda1 458G 44G 391G 11% /etc/hosts
shm 64M 0 64M 0% /dev/shm
tmpfs 3.8G 0 3.8G 0% /proc/asound
tmpfs 3.8G 0 3.8G 0% /proc/acpi
tmpfs 3.8G 0 3.8G 0% /proc/scsi
tmpfs 3.8G 0 3.8G 0% /sys/firmware

oracle cloud (OCI) free training and certification

Oracle offering free cloud training and certification.

Do you work with Oracle Cloud Infrastructure or Autonomous Database?
This one’s for you: we’re offering FREE access to learning content and certification until May 15th. Get the full details here: http://ora.cl/vQ4u4

I registered some certifications. Exam dates available till Aug 14th 2020. Online exam available through pearsonvue. You need oracle account and pearsonvue account to complete this certification.

Image may contain: text

Disclaimer: I am not afiliated to Oracle, just sharing the free offering. Take it or leave it.

Azure automation using powershell

Editor to use: your choice

prefered: visual studio code (free and meant for azure automation, cross-platform)

This article is about to configure  power shell editor: Windows powershell ISE

PS C:\Users\user1> Install-Module azureautomationauthoringtoolkit -scope CurrentUser

PS C:\Users\user1> Import-Module -name azureautomationauthoringtoolkit
Import-Module : File C:\Users\user1\Documents\WindowsPowerShell\Modules\azureautomationauthoringtoolkit\0.2.4
.2\AzureAutomationAuthoringToolkitInner.psm1 cannot be loaded because running scripts is disabled on this
system. For more information, see about_Execution_Policies at https:/go.microsoft.com/fwlink/?LinkID=135170.
At line:1 char:1
+ Import-Module -name azureautomationauthoringtoolkit
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : SecurityError: (:) [Import-Module], PSSecurityException
+ FullyQualifiedErrorId : UnauthorizedAccess,Microsoft.PowerShell.Commands.ImportModuleCommand

To make it work:

Get-ExecutionPolicy -scope CurrentUser

Then got this warning. What to do now yes/no

Powershell_securitywarning

Got below error. Through this powershell automation, windows is trying to change to unix like OS, but still long way to go.

Betterway I think is giving us option like sudo in unix, running such high privileged commands, instead rerunning entire powershell with “Run as administrator”. But I can understand windows team is tranisitioning takes time to mature.

Set-ExecutionPolicy -ExecutionPolicy RemoteSigned

Set-ExecutionPolicy : Access to the registry key ‘HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\PowerShell\1\ShellIds\Microsoft.PowerShell’ is denied. To change the execution policy for the default (LocalMachine) scope, start Windows PowerShell with the “Run as administrator” option. To change the execution policy for the current user, run “Set-ExecutionPolicy -Scope CurrentUser”.
At line:1 char:1
+ Set-ExecutionPolicy -ExecutionPolicy RemoteSigned
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : PermissionDenied: (:) [Set-ExecutionPolicy], UnauthorizedAccessException
+ FullyQualifiedErrorId : System.UnauthorizedAccessException,Microsoft.PowerShell.Commands.SetExecutionP
olicyCommand

when I reran in powershell with “Run as administrator” it worked. I hope I remember to reset this after my powershell practice as it puts me at great risk

Set-ExecutionPolicy -ExecutionPolicy RemoteSigned

Another x86 vs x64 dilemma

PS C:\Users\user1> Import-Module -name azureautomationauthoringtoolkit -scope Global
Windows PowerShell Workflow is not supported in a Windows PowerShell x86-based console. Open a Windows PowerShell x64-based console, and then try again. At C:\Users\user1\Documents\WindowsPowerShell\Modules\azureautomationauthoringtoolkit\0.2.4.2\AzureAutomation AuthoringToolkit.psm1:1 char:1
+ <#
+ ~~
+ CategoryInfo : OperationStopped: (:) [], NotSupportedException
+ FullyQualifiedErrorId : System.NotSupportedException

Finally it worked after run as x64.

Next thing is to authenticate Azure

AzureAutomation-windowsPowerShell_ISE