It is about seven years ago now that I crowded into a meeting room in San Mateo, California, and was introduced to the entire staff of MarkLogic. I was in the midst of a negotiation just up the road in Burlingame to sell my company to Outsell, but I had been energised by a conversation with Dave Kellogg, the very charismatic CEO of the young MarkLogic, to pay them a visit. “Stand over here”, said Kellogg, “and tell us where Europe is”. Presuming that he meant European publishing, rather than the Alps and the Pyrenees, I began a halting description of a market in slow digital transition, but was soon overtaken by other voices. Apparently, MarkLogic was the latest thing in database technology, and apparently the primitive nature of the market I had been apologetically describing, was pure opportunity lurking in the shadows and waiting to be turned into the stardust of a new age of media management. I drove away feeling that we might have gone an adjective too far in our enthusiasm but that something here had to be watched. This week I found out what that was.

Since that meeting I have had a long and pleasurable association with the company, and last week its annual user show arrived in a Europe it now knows intimately, with MarkLogic World 2015 conferences in Amsterdam and London. Alongside these events a dinner for publishing people took place, and I was able to attend and speak at both. With revenues last year marching past the $100m marker, and with a further funding round completed last week producing a further $100m in investment from backers that included Sequoia and Wellington, this is another emerging Silicon Valley force to be reckoned with in software. You would need a conference facility to speak to its 400 plus staff, and it is currently just discovering where AsiaPacific is – in media terms. And while publishing was a very proper starter market, the company is deeply embedded in government computing (Obamacare), broadcasting (the BBC Sports Olympic coverage was a breakthrough moment for a database that could allow 13 million viewers that ability to configure their own personalised view of the content), financial services and in all those accidental publishing places where entities who never thought of themselves as media now find that in a network context that is exactly what they are.

I am not the right person to expound on NoSQL databases, though I get a stronger sense each year that I am looking at the next Oracle, now directed by the equally charismatic Gary Bloom, a business leader whose own experiences were shaped in the Oracle that now faces this competitive pressure. Nor should I be writing about semantic analysis, triple stores or the vital importance of being able to work with structured and unstructured data in the same context. But I do now see clearly what happens as a result, and the transformation these technologies are creating in the lives of the people around those dinner tables. Job titles here become meaningless. These hard-working people were various designated as CTO, CIO, Chief Data Officer, Data Architect, Chief Product Manager, Business Development Manager and many more combinations of these. But they were around those tables because of a shift in power that has taken place throughout the media, and I slowly realised how little we have taken that shift into account and what it means for creativity in our businesses.

In the dim and distant past, in Old Publishing, editorial direction was the root of creativity. We spoke of “flair” and “hunch” as components in the business of selectivity. Then, we had Marketing, and we spoke of “fieldwork” and “research” as the drivers of creative decision making about how to formulate our products and develop our offerings. Many of us have now moved to the next stage as well, but it could be argued that we are in some respects still living in the Marketing-driven world. In very crude terms I could argue that the Editorial world was driven by format – books, magazines, newspapers. The Marketing phase was driven by content – trying to assemble content ever more carefully to meet the perceived needs of customers. The current drive, although it began in the search for ways of speeding up new product development, is towards Solutions, producing answers to real problems expressed by users, but creatively organising those solutions so that they produce measurable customer benefit, aka Value, often expressed in terms of productivity or cost saving.

And who in our information business is organising this new creativity? Not the editorial department, who are now just a part of process, if they exist at all. Not the Marketing department, who are solely occupied in presenting the results of what we produce to the customers we are trying to reach. The real creatives in information companies are those responsive to the unrecognised force derived from living in a networked society: in a networked economy the service requirement derives from the all-powerful user. All those job titles listed above, from CTO to Data Architect, are increasingly being turned inside out, and ceasing to be functions of internal systems development. Instead they are becoming the way in which we respond to what markets need, design solutions that make sense to end users, and create wealth.

If this is the case then some will feel that the creative role of the Data Architect is grossly under-recognised. I would agree, though the power in these roles, derived at once from a networked economy and from the rapid proliferation of intelligent ways of organising data like MarkLogic, is shown both in the scramble to recruit talent in this field and by the growing influence it has on budgets and expenditure. And this also raises a worry. If these people are the creative cadre of the future, are information businesses exposing them sufficiently to their customers. And given that customers never entirely told the truth in the long history of market research (a bit like political opinion polling?) do the designers of our solutions get enough observation time inside the customer context to discern where value may lie? We have the project development strategies (Agile et al) and we have the tools and structures, but do we have the evidence upon which to make decisions that will add value in contexts where our customers expect ever more customized responses from us?

The nature of networks is collaboration. If we spoke of the Networked Society instead of the Digital Age we might begin to understand the implications of this. Although the tools we use are still crude, every day in the life of every office, or every research laboratory, groups of people are getting together to discuss work, and learn from each other. Moving the sharing from a room with a desk to a conference call and then to a screen simply offers process improvement, to which universal internet access adds the ability to exchange content on the fly. In the view of a collaborator in such a process, any request for information which furthers the group work objective should be answered – we do it ourselves and expect it of others. Collaboration has no rulebook except the need to gratify the requirements of the group focus. Who does not know this and practise it their daily lives?

Well, clearly the STM Association has only just found out. I apologize for not commenting earlier on the announcement in February of a consultation (a helpful change since publisher groupings are more usually into pronouncements) by that association on SSNs and SCNs. Are they a threat to scholarly publishing as we know it, the regulation of ownership, or life on earth? Amazing how you need only apply a three letter acronym to something that everyone was doing anyway and you can effectively demonize it. But what we are really talking about here are networks like ResearchGate, or Mendeley, or Academia.edu or ReadCube or FigShare. As a group they could be described as Scholarly Collaboration (or Sharing) Networks. Those who join them share problems and issues – and content – and sometimes do so as public network members and sometimes do so as private groups, with the network hosting the activity of scholars drawn from different places, just as scholars have always met at conferences and just as very many groups of scholars still meet online undignified by having a three letter acronym to describe what they are doing. Sometimes the SCN has attributes which add further value to collaboration – data collections, or indications of who holds which articles – but the collaboration is the essence. They have millions of members (including students and members of the public, who should of course be caught and charged immediately!).

Now there are elements to this consultation which strike me as highly risible. While I know that, under Fred Dylla as chair, the consultation will be conducted impeccably and with total integrity and fairness, the difficulties that this enterprise faces are daunting. Its not just that SCNs are ways of helping researchers do something they will do anyway, regulated or not. Its not just that publisher attempts to regulate what they do have never made the slightest difference in the past and are unlikely to do so in the future. Its not even the sight of STM making the ungainly ascent into the seaside throne of Canute that amuses so much. It is the fact that most of the SCNs who are possibly involved in the widespread transference of copyrighted scholarly materials between researchers who do not always have formal permission for those transfers, are owned and funded by … publisher members of STM.

My sympathies will always lie with the market. Follow the end user can be the only guideline in a networked society. What Elsevier or Digital Science did here with the creation of these SCNs was simple good sense and they deserve the commercial returns that their efforts on behalf of collaborative scholarship should earn them. Those of us who said loudly a decade ago that Open Access was not the real danger to the established hegemony – it was networked publishing that provided the threat, were told that the major STM players were quite capable of taking the paper journal world into the network and preserving its rules and conventions just as long as research funders did not insist on an author pays model. Well, they were wrong, as people always are when they insist that they can move business models to digital networks without change. Just this week in the UK, on the blasted heath that once was newspaper publishing, a group of news publishers banded together to form the Pangaea Collaboration for selling advertising (CNN, Reuters, Economist, Financial Times, spearheaded by the Guardian) which will allow “brands to collectively access a highly influential global audience via the latest programmatic technology”. In other words, erstwhile deadly competitors getting together to offer tech enabled solutions to customers who have the power to make choices.

Which is probably the answer to the STM question. Trying to alter market behaviour by regulation is fruitless, Forming a ring around current SCNs and licensing them collectively to do what they will do anyway must be more sensible. Creating niched SCNs for research specialities and going to where you can add yet more value must be the way forward. Surprizingly many commercial players see this – but scholarly societies, dependent for survival on journal sales and advertising, are very much more conservative. But then again, the scholars using the SCNs are usually members of those societies, whose role is perhaps what is most at stake here – and of course many commercial publishers make a living by the services that they sell to those scholarly societies. When we look back at a train of events (Macmillan setting up Digital Science, Elsevier buying Mendeley, Nature making all articles free to subscribers, Wiley adopting ReadCube etc) we can be confident that this train is not suddenly going into reverse. The answer for STM members may well be collaboration, but it will be fascinating to see how they attain it.

« go backkeep looking »