Would you like to help us out? We would love your help! If you have an idea for an article, know someone who is doing cool stuff with data, or want to contribute an article for Datagami yourself then please contact us at contact@datagami.blog. You can also follow us or share the site with your... Continue Reading →
What is a Data Strategy?
About ten years ago, I was phone screened for a job that I had applied for – the person interviewing me asked me what I thought made up a good data strategy. At the time, my job was very focused on building out an enterprise data warehouse and our daily conversations were about slowly changing... Continue Reading →
IndexError: list index out of range in using fetch_pandas_all() on Snowflake
Ah, my favorite type of error: sporadic! A day days we started getting failures when using fetch_pandas_all() against Snowflake. The query was a basic 'SELECT *' against an analytical data set. Here is the trace: Traceback (most recent call last): File "/Users/david/path/test/main.py", line 31, in <module> df = cs.fetch_pandas_all() File "/Users/david/path/.scriptenv/lib/python3.8/site-packages/snowflake/connector/cursor.py", line 978, in fetch_pandas_all... Continue Reading →
Using Snowflake Key Pair Authentication with Tableau Desktop
I have gotten irrationally annoyed at the (admittedly minor) process of connecting directly to Snowflake lately. When I am using my saved Tableau Online Data Sources it is a single click to connect. When I am connecting directly to Snowflake, I need to go login to my password vault, find my account, copy and paste... Continue Reading →
Tableau, I love you, but you’re bringing me down
https://youtu.be/-eohHwsplvY Not too long ago, we (the Datagami contributors) had a call, and the topic of data viz tools came up. Those of us using them love Tableau but were all moving away from it, mainly due to the heavy-handed pricing structure. (Microsoft Power BI has this beat, and my company's moving to a new... Continue Reading →
Does Your Title Reflect Your Position in Data Warehouse Development?
I’ve been working in the realm of data for a long time. During that time, companies have evolved titles and job descriptions. Sometimes those titles can be confusing, however. For the longest time, I was called a Data Warehouse Analyst, but I was actually doing more hands-on development than analyzing. That sometimes became problematic when... Continue Reading →
Did Agile kill the Business Analyst Star?
Where have all the business analysts gone? Agile seems to have placed less emphasis on having a formal business analyst role. Teams end up looking to product owners and developers to analyze and gather requirements. But that can lead to some frustrations and potentially slow your velocity. Is it time to formalize the business analyst role on an Agile team?
Little Data is Sexy Too
I regularly attend conferences and meetup groups focused on data and business intelligence (BI) in order to keep up my industry knowledge, network with my peers and just because I enjoy talking about data. These are virtual now with Covid, but over the last few years, I’ve noticed that while the topics are fun and... Continue Reading →
Connecting Snowflake to Esri Coming Soon
Earlier this year, I wrote a brief post about how to connect Snowflake to Esri's ArcGIS. That worked for version 10.4. When we upgraded to 10.7, the ODBC connection appeared to connect to Snowflake but wouldn't actually retrieve any data. Today, I finally was able to connect w/ some Esri folks to learn about their... Continue Reading →
Why is data governance important?
Today, we're featuring a guest blogger. Kimberly Miles is a seasoned IT Leader with 10+ years of specialized experience overseeing technical program and data product management, driving product vision, strategy, and innovation. One of the obstacles to managing data is justifying why a data strategy is essential. For data-obsessed people like me, data governance is... Continue Reading →
Choose your names wisely
Tip: Avoid using reserved words as object names. The other day, I chose a name for a schema in SQL Server that had some unintended consequences. I had created some audit tables to track historical changes and named the schema "audit". It didn't occur to me that "audit" is a SQL Server reserved word. I... Continue Reading →