Provisioning Stateful Kubernetes Containers that Work Hard and Stay Alive
(This blog is the second installment of a four-part series) By default, all containers are free from limits but subject to eviction By default, Kubernetes places very few limits on a container. A...
View ArticleStoring Stateful Data that Outlives a Container or a Cluster; Optimizing for...
(This blog is the third installment of a four-part series) Kubernetes can automatically provision “remote persistent” volumes with random names Several types of storage volumes have built-in Kubernetes...
View ArticleManaging Stateful Apps with the Operator Pattern; Orchestration Considerations
(This blog is the fourth installment of a four-part series) The Operator Pattern The Operator Pattern stipulates a process that is registered with the Kubernetes system layer, listening to Kubernetes...
View ArticleTransferring Time-based One-time Passwords to a New Smartphone
Abstract Smartphone authenticator apps such as Google Authenticator and Authy implement software tokens that are “two-step verification services using the Time-based One-time Password Algorithm (TOTP)...
View ArticleUsing Greenplum to access Minio distributed object storage server
Pivotal Greenplum Database® (GPDB) is an advanced, fully featured, open source data warehouse. GPDB provides powerful and rapid analytics on petabyte scale data volumes. Greenplum 5.17.0 brings support...
View ArticleEureka, Zuul, and Cloud Configuration - Local Development
Overview A couple of recent projects I have been on have started our engagement with the Netflix stack described here, and because I wanted to have a way to quickly prototype, I set up this demo. This...
View ArticleEureka, Zuul, and Cloud Configuration - Pivotal Cloud Foundry
Overview In a previous post I explained how you could create several components to build a Netflix stack for local development. Now, I want to explain how Pivotal Cloud Foundry makes this much easier....
View ArticleTesting Spring filters without pain
The Spring framework has grown and changed at a massive pace over the last years. It has evolved from XML configured beans to annotation based beans, from synchronous to a non-blocking and reactive...
View ArticleHow we moved a massively parallel Postgres database onto Kubernetes
If you’ve ever wondered what type of applications are the best candidates to run on Kubernetes, distributed applications that scale out, such as Greenplum, are certainly at the top of the list, as...
View ArticleA High-performing Mid-range NAS Server, Part 3: 10 GbE
Abstract “How much faster will my VM’s disks be if I upgrade my ZFS-based (Z File System) NAS to 10 GbE?” The disks will be faster, in some cases, much faster. Our experience is that sequential read...
View ArticleEnsure Windows apps are using the `windows` stack
Pivotal Application Service for Windows introduced the -s windows stack name in PASW 2.4, reducing the operator and developer need to concern themselves with specific Windows Server versions. From PASW...
View ArticleFast Access to Your S3 Data with Greenplum PXF
In this article, we introduce the PXF feature that utilizes S3 Select for faster access to data on AWS S3. As an introduction to basic concepts, we first provide a brief introduction to the...
View ArticleAdministering a PXF cluster using the PXF Command Line Interface
Objective This blog aims to demonstrate some simple, but essential workflows that use the PXF CLI to administer an installation of PXF on a Greenplum cluster. Prerequisites This post assumes that a...
View ArticleGreenplum: Speeding up JDBC Reads in PXF Using Partitioning
Pivotal Greenplum Database® is an advanced, fully featured, open source data warehouse. Greenplum provides powerful and rapid analytics on petabyte scale data volumes. PXF is a query federation engine...
View ArticleMerge Join Support In GPORCA
Introduction Pivotal’s SQL Optimizer, GPORCA, handled full outer joins by creating a union of a left outer join and a left anti-semi join, making any GPORCA generated plan slow and prevented GPORCA...
View ArticleESM Study Data
Studying the experience of XP Teams This is the raw data (after anonymization, and after the removal of freeform fields, out of an abundance of caution, so as not to leak any intellectual property) of...
View ArticleHow we built a controller using KubeBuilder with Test Driven development, Part 1
Who are we? We are the Greenplum for Kubernetes team. We’re working on a Kubernetes operator to run Greenplum, and connected components of Greenplum like PXF and GPText. We started with a controller...
View ArticleHow we built a controller using KubeBuilder with test-driven development, Part 2
Who are we? We are the Greenplum for Kubernetes team. We’re working on a Kubernetes operator to run Greenplum, and connected components of Greenplum like PXF and GPText. We started with a controller...
View ArticleBenchmarking Apache Geode's Performance
Measuring Geode’s Performance Apache Geode™ is an in-memory data grid that provides real-time, consistent access to data-intensive applications throughout widely distributed cloud architectures. Data...
View ArticleESM Pairing Study Data
Studying the experience of Pair Programmers This is the raw data (after anonymization, and after the removal of freeform fields, out of an abundance of caution, so as not to leak any intellectual...
View ArticleScaling Doppler VMs in Cloud Foundry
Why care about Dopplers You might be wondering what a Doppler is (and why you care about it). Doppler VMs are a core component of log and metrics transport; one that you probably won’t care about until...
View ArticleScaling the Firehose API and Consumers
Scaling the Loggregator API So you’ve used this article to correctly scale Dopplers in your Loggregator system. Even so, you notice that you’re still experiencing log loss. It could be that your log...
View ArticleHow To Enable IPv6 on Your Cloud Foundry's HAProxy
0. Abstract HAProxy is an optional load balancer included in the canonical open source Cloud Foundry deployment. Its intended use is on IaaSes (Infrastructures as a Service) that do not offer built-in...
View ArticleFlow Your Tests Like Your Code
My co-worker Belinda Liu turned to me and said, “I don’t like these tests at all; they’re hard to follow, and I’m not sure what they’re testing.” I looked at the tests that I had spent much of...
View ArticleFaking OAuth2 Single Sign-on in Spring, 3 Ways
When writing a Java Spring web application that uses an OAuth2 single sign-on (SSO) service for authentication, testing can be difficult, especially if the SSO service is provided by a third party. In...
View Article