Skip to content
This repository has been archived by the owner on Oct 4, 2024. It is now read-only.

Updated Splunk Quick Start #44

Open
wants to merge 62 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 55 commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
8af4a53
add templates for smartstore
Aug 14, 2019
c52e00f
added smartstore support
theckm May 6, 2020
31f41c1
Update splunk-enterprise-master-ss.template
May 7, 2020
672a208
Create user_data.sh
May 13, 2020
5e09070
Update user_data.sh
May 13, 2020
3b5875b
updated for further testing using user_data.sh
billbartlett May 20, 2020
a385884
changed timeout for CM wait condition
billbartlett May 20, 2020
3dc459f
decrease cm timeout condition to 15 minutes
billbartlett May 20, 2020
f00266d
changed timeout for CM to 10 minutes.
billbartlett May 21, 2020
efac84e
housekeeping
billbartlett May 21, 2020
1ee5b78
fixed location of the user_data.sh download. it was inadvertently lo…
billbartlett May 21, 2020
884087a
added time to ansible start script to see how long the installation t…
billbartlett May 22, 2020
92cb531
fixed some syntax issues and added echo statements to the functions.
billbartlett May 22, 2020
3b3dc28
add splunk cluster master to user_data.sh process
billbartlett May 27, 2020
01e6913
updated to add splunk cluster manager to user_data script
billbartlett Jun 8, 2020
c151a01
adding license by default for testing
billbartlett Jul 9, 2020
989e85c
add 0.0.0.0/0 as access CIDR by default for easier testing
billbartlett Jul 9, 2020
c92fe87
.
billbartlett Jul 9, 2020
9641ec4
moved all of the code that runs on every machine to a 'base' function.
billbartlett Jul 13, 2020
b91040e
changed location that splunk license installs to
billbartlett Jul 13, 2020
555c1ac
changed minimum indexer count to 4 instead of 3
billbartlett Jul 16, 2020
56cdbf7
migrated search head cluster logic to user_data.sh
billbartlett Jul 16, 2020
5ffa5bd
updated functionality for clustered search heads
billbartlett Jul 23, 2020
0913c16
migrated indexer cluster to user_data.sh
billbartlett Jul 23, 2020
489450d
added sleep to ensure splunkd is fully up before editing cluster config
billbartlett Jul 23, 2020
e441d9a
updated instance types
billbartlett Jul 23, 2020
201f4a4
clean up instance type selection, and add nvme drive setup code for i…
billbartlett Sep 14, 2020
7ec5120
Update user_data.sh
billbartlett Oct 13, 2020
1d06a41
initial commit of YAML conversion
billbartlett Oct 13, 2020
ba45368
initial adoc commit
Jan 22, 2021
a8c2975
removing/renaming old templates, updating some docs
Feb 12, 2021
c3793e4
updating docs and associated images
Feb 25, 2021
f4c4a60
cleanup and rename of templates
Feb 25, 2021
b396f1e
cleaning up docs
Mar 9, 2021
311ae3d
updated readme to highlight a splunk license is now required for quic…
Apr 20, 2021
e0e87ae
updated quickstart cloudformation to utilize smartstore, as well as
billbartlett Apr 4, 2022
898d9c8
fix default parameter values
billbartlett Apr 7, 2022
73248c8
fix default values
billbartlett Apr 26, 2022
cc35fe2
per quickstart team instructions, remove docs from main branch
billbartlett Apr 28, 2022
73315f0
rename templates
billbartlett May 10, 2022
3252c2c
Merge branch 'main' of github.com:splunk/quickstart-splunk-enterprise
billbartlett May 10, 2022
407c9fc
add .metadata
billbartlett May 11, 2022
1bfc729
update Splunk AMI to 8.2.6
billbartlett May 20, 2022
1ff306c
removed duplicate description in template
billbartlett May 20, 2022
3b20f2d
reordering
billbartlett May 20, 2022
38dbe3e
testing
billbartlett May 20, 2022
ba54d82
rename main template
billbartlett May 21, 2022
e17366b
Revert "rename main template"
billbartlett May 21, 2022
d0e1e75
Merge branch 'main' of github.com:splunk/quickstart-splunk-enterprise
billbartlett May 21, 2022
6b43ef1
update main template
billbartlett May 21, 2022
bf365cc
Merge branch 'main' into main
billbartlett May 21, 2022
d304c7d
update AMI to include 8.2.6
billbartlett May 21, 2022
fa64656
fix the template name called -- after renaming the template to end in…
billbartlett May 30, 2022
2b2e203
remove default value for QS bucket name in nested stack.
billbartlett May 30, 2022
27f266a
fixed typo in user_data.sh and updated taskcat YAML
billbartlett Aug 26, 2022
7b9ef19
fixes per quickstart team's request
billbartlett Sep 12, 2022
0946167
fixes to utilize taskcat pseudo parameters
billbartlett Sep 12, 2022
10cbda4
linter fixes
billbartlett Sep 14, 2022
52e3109
linter fix (master -> manager)
billbartlett Sep 14, 2022
2a8de5d
add instance types
Oct 7, 2022
43b54b5
updated to remove cfn-init functionality from the script and put it b…
Oct 9, 2022
db0a3f1
changed downloads of user_data.sh
Oct 9, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .metadata
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
language_type: cloudformation
55 changes: 29 additions & 26 deletions .taskcat.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,36 +3,39 @@ project:
owner: quickstart@amazon.com
package_lambda: false
regions:
- ap-northeast-1
- ap-northeast-2
- ap-south-1
- ap-southeast-1
- ap-southeast-2
- ca-central-1
- eu-central-1
- eu-west-1
- eu-west-2
- sa-east-1
- us-east-1
- us-east-2
- us-west-1
- us-west-2
s3_bucket: ''
tests:
splunk-enterprise:
parameters:
AvailabilityZones: $[taskcat_genaz_2]
HECClientLocation: 10.0.0.0/16
KeyName: taskcat-test
QSS3BucketName: $[taskcat_autobucket]
QSS3BucketRegion: $[taskcat_current_region]
SSHClientLocation: 10.0.0.0/16
SplunkAdminPassword: $[taskcat_genpass_10]
SplunkClusterSecret: $[taskcat_genpass_10]
SplunkIndexerDiscoverySecret: $[taskcat_genpass_10]
WebClientLocation: 72.21.196.66/32
AvailabilityZones: us-west-2a,us-west-2b
billbartlett marked this conversation as resolved.
Show resolved Hide resolved
KeyName: [your-aws-keypair]
QSS3BucketName: [quickstart-bucket-name]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

USe $[taskcat_autobucket]

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the QSS3BucketName will need to be a bucket that contains the quickstart code. isn't $[taskcat_autobucket] used for random bucket names?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For testing, $[taskcat_autobucket] is used by CI to create a temp bucket, upload the repo content and test from that bucket. In the template, the parameter default value needs to be quickstart bucket name, as thats where the templates are staged for customers to deploy.

QSS3KeyPrefix: quickstart-splunk-enterprise/
QSS3BucketRegion: us-west-2
billbartlett marked this conversation as resolved.
Show resolved Hide resolved
SplunkAdminPassword: Splunk123!
SplunkClusterSecret: Splunk123!
billbartlett marked this conversation as resolved.
Show resolved Hide resolved
SplunkIndexerDiscoverySecret: Splunk123!
IndexerInstanceType: i3.4xlarge
SearchHeadInstanceType: c5.4xlarge
SplunkIndexerDiskSize: '500'
SplunkSearchHeadDiskSize: '500'
SHCEnabled: 'no'
SplunkIndexerCount: 4
SplunkReplicationFactor: 2
SplunkSearchFactor: 2
SplunkLicenseBucket: [splunk-license-bucket-name]
SplunkLicensePath: [splunk-license-file]
Comment on lines +27 to +28
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need splunk license file for the testing? If yes, can you provide a test file via email, for our CI, so that our CI platform can test the QS automatically?

WebClientLocation: 1.2.3.4/32
HECClientLocation: 1.2.3.4/32
SSHClientLocation: 1.2.3.4/32
VPCCIDR: 10.0.0.0/16
PublicSubnet1CIDR: 10.0.1.0/24
PublicSubnet2CIDR: 10.0.2.0/24
PublicSubnet3CIDR: 10.0.3.0/24
NumberOfAZs: 2
SmartStoreBucketName: [your-smartstore-bucket-name]
billbartlett marked this conversation as resolved.
Show resolved Hide resolved
regions:
- us-west-1
- us-east-2
- us-west-2
s3_bucket: ''
template: templates/splunk-enterprise-master.template.yaml
template: templates/splunk-enterprise-main.template.yaml
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ View the accompanying [deployment guide](https://fwd.aws/bGBmy) for everything y

### Prerequisites

Before getting started with the template configuration, you will need to make your Splunk Enterprise license privately accessible for CloudFormation template deployment via S3 download. The following steps will guide you through that process. *(Note: This step is not required, and you can upload your license from the Splunk web interface. It is, however, required that you have a non-trial Splunk Enterprise license to fully utilize the deployment our template creates. If you don't already have a Splunk Enterprise license, you can obtain one by contacting sales@splunk.com.)*
Before getting started with the template configuration, you will need to make your Splunk Enterprise license privately accessible for CloudFormation template deployment via S3 download. The following steps will guide you through that process. *(Note: This step is required. A non-trial Splunk Enterprise license is required to allow our template to configure the Splunk deployment. If you don't already have a Splunk Enterprise license, you can obtain one by contacting sales@splunk.com.)*

1. From the AWS Console, select "S3" under the "Storage" heading, or by simply typing "S3" into the search bar.
2. You can either select an existing private bucket to upload to, or create a new one. If you select an existing bucket, make sure its access policy does not grant public access. By default, all the S3 resources are private, so only the AWS account that created the resources can access them. For this exercise, I'm outlining how to create a new bucket.
Expand Down
Loading