There is a popular opinion article Too many AI researchers think real-world problems are not relevant that has come across my LinkedIn feed on multiple occasions. I can only, in good concious, scan past it 2 or 3 times before I feel responsible to understand why this issue is so important that it keeps repeating. The subtitle, namely “The community’s hyperfocus on novel methods ignores what’s really important”, provides more insight into the argument....
I have fallen a bit behind on my 100 days to offload pace. Certainly not from lack of interesting discoveries or happenings, rather too many overlapping my time to write. I’m hoping to get back on track with this post about Delta Lake, databricks open-sourced data lakehouse implementation. This discussion surrounds the paper Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores. I highly recommend the read, in doing so I gained deeper insight into the direction of data storage including specific industry use-cases and the relationships between storage solutions thereof....