So let me be more specific. The way I’m seeing Data Factory being used (a component of Fabric) is taking SSIS packages and now running them in the cloud. That’s not the only way to use data factory - but as long as you don’t have to rewrite SSIS jobs I imagine many people won’t... but then you have the limitations of the tech that was already in place - with some benefit of now having a cloud runner. PowerBI is also part of fabric - and the reason I hear from others as to why they use it is ALWAYS “because it was cheaper” not better. Plus the cheaper was just in LICENSING cost (not counting other costs).
The bizarre part - Microsoft Excel is a tool people still truly love. I’m sure MS product teams would love to bottle that Excel lovin’ and spread to other MS data products - but IMO that hasn’t happened.
I read this and worry that my concerns are real that the data world has been hijacked by people who would rather create governance frameworks and controls, than find (or allow others to find) insights and understanding in data. I think this is in large due to its promotion to ‘the new oil’ and the explosion in roles which are often siloed in the data stack. The increase in status leads to greater scrutiny, and the increase in silos increases the likelihood of errors and mistakes due to lack of insight…which leads again to greater scrutiny.
In governance specifically, I think there is a data lifecycle which starts being produced by business process, when that process is entered into an application, and via ingestions and transformations into reporting, through influencing and into action/decisions. So far regulatory governance approaches I’ve seen only inspect the problem of (a small amount of the ingestion,) transformations and models, but still manages to miss the two key ends of the process. I believe this is one reason why it’s boring - it seems like overhead that is added doesn’t solve the key issue of knowledge gaps in understanding what processes, developer choices, and manager idiosyncrasies help data be productive and valuable
Ya that’s my impression so far. I’m trying to be open minded... but ya. Oh and absolutely if MS built something extraordinary that they just couldn’t sell to their enterprise customers because it was too big of a change or too different - that certainly doesn’t work. Plus to your point I don’t think they are asking for something completely new and different.
My Microsoft Fabric comments - I have not spent much time - however what I have seen are some existing tools being rebranded as MS Fabric. I took a 5 year break from the Microsoft stack... As I dive back in things feel waay too similar to the SSXSs of old. It feels like the same philosophy with some shiny sprinkled on top. I know there are *some* net new tools. but I struggle to think MS is going to all of a sudden become a leader here....
Transforming into San Diego
So let me be more specific. The way I’m seeing Data Factory being used (a component of Fabric) is taking SSIS packages and now running them in the cloud. That’s not the only way to use data factory - but as long as you don’t have to rewrite SSIS jobs I imagine many people won’t... but then you have the limitations of the tech that was already in place - with some benefit of now having a cloud runner. PowerBI is also part of fabric - and the reason I hear from others as to why they use it is ALWAYS “because it was cheaper” not better. Plus the cheaper was just in LICENSING cost (not counting other costs).
The bizarre part - Microsoft Excel is a tool people still truly love. I’m sure MS product teams would love to bottle that Excel lovin’ and spread to other MS data products - but IMO that hasn’t happened.
I read this and worry that my concerns are real that the data world has been hijacked by people who would rather create governance frameworks and controls, than find (or allow others to find) insights and understanding in data. I think this is in large due to its promotion to ‘the new oil’ and the explosion in roles which are often siloed in the data stack. The increase in status leads to greater scrutiny, and the increase in silos increases the likelihood of errors and mistakes due to lack of insight…which leads again to greater scrutiny.
In governance specifically, I think there is a data lifecycle which starts being produced by business process, when that process is entered into an application, and via ingestions and transformations into reporting, through influencing and into action/decisions. So far regulatory governance approaches I’ve seen only inspect the problem of (a small amount of the ingestion,) transformations and models, but still manages to miss the two key ends of the process. I believe this is one reason why it’s boring - it seems like overhead that is added doesn’t solve the key issue of knowledge gaps in understanding what processes, developer choices, and manager idiosyncrasies help data be productive and valuable
Ya that’s my impression so far. I’m trying to be open minded... but ya. Oh and absolutely if MS built something extraordinary that they just couldn’t sell to their enterprise customers because it was too big of a change or too different - that certainly doesn’t work. Plus to your point I don’t think they are asking for something completely new and different.
My Microsoft Fabric comments - I have not spent much time - however what I have seen are some existing tools being rebranded as MS Fabric. I took a 5 year break from the Microsoft stack... As I dive back in things feel waay too similar to the SSXSs of old. It feels like the same philosophy with some shiny sprinkled on top. I know there are *some* net new tools. but I struggle to think MS is going to all of a sudden become a leader here....
Microsoft Fabric takes away the boring stuff, and leaves the real work.
Ben, I usually provide critical feedback in private, but you strike me as the kind of guy who doesn’t really care 😁
In the paragraph starting “Bluntly” it should say “too closely” instead of “to closely”