Social Feed Manager is open source software that harvests social media data and web resources from Twitter, Tumblr, Flickr, and Sina Weibo. It empowers researchers, faculty, students, and archivists to define and create collections of social media data. By running Social Feed Manager on behalf of their communities, cultural heritage and research organizations can provide an innovative service. Members of the GW community who wish to collect social media data will find more information at GW Libraries.
Yonah Bromberg Gaber shares a proof-of-concept using Scrapy for finding Twitter handles in websites.
In the fifth post in the SFM for Archivists series, Chris Prom digs into the SFM data model and the implications for preservation.
In the fourth post in the SFM for Archivists series, Chris Prom offers three basic access scenarios for social media collections.
In the third post in the SFM for Archivists series, Chris Prom explores possibilities for a social media research consulation service.
In the second post in the SFM for Archivists series, Chris Prom discusses strategies for shaping local collections.
In the first post in the SFM for Archivists series, Chris Prom outlines a few potential institution-led collecting efforts that repositories may wish to cons...
On the eve of the one year anniversary of version 1.0, the SFM team released version 1.9.
Middle East & North Africa Librarian Amanda Hannoosh Steinberg shares her experiences creating curated research collections for Middle East Studies, includin...
We're pleased to share this report by Christopher Prom of University of Illinois, which assesses Social Feed Manager, offers thoughts for how it can support ...
A selected list of resources for consideration when embarking on social media collecting.
We collect tweets from almost every member of Congress, and we provide the list of handles here.
On May 18, Twitter announced changes to its Developer Policy that has significant impacts for researchers and archivists. The goal of this blog post is to de...
In version 1.8 of Social Feed Manager, we treated ourselves to a handful of enhancements and fixes.
Here's what we collected on May 4, 2017 with SFM.
SFM provides the opportunity to collect useful metadata about the geographic location of tweets provided by the Twitter API.
A quick blog post for a quick release.
On March 28, two dozen George Washington University faculty gathered over lunch to discuss social media research.
This post describes the impact of recent changes made by Twitter to allow extended tweets on the REST and Streaming APIs.
In between GW’s spring break and late season snow storm, we squeaked in version 1.6 of Social Feed Manager.
We're pleased to share some recently-developed guidelines on building social media archives.
Instructions are now available for exporting a dataset from SFM and publishing to Dataverse.
We've made incremental improvements to several key features in version 1.5.
Under the wire, version 1.4 is our 8th release of SFM for 2016.
The SFM team released a dataset of 280 million tweet ids related to the 2016 U.S. presidential election.
To help our future selves (and you), we've documented some of the tips and tricks for processing Twitter data with jq.
The highlights of version 1.3 of Social Feed Manager.
A Jupyter notebook that explores the affordances of the Twitter API for retweets, replies, quotes, and favorites.
This blog post describes how to get your content OUT of SFM.
The SFM team has overcome the confluence of a series of conferences, vacations, holidays, nasty colds, and other deadlines to get version 1.2 wrapped up.
Version 1.2 of Social Feed Manager will contain a passel of improvements to our social media harvesters.
In between summer vacations and public transit hurdles, we've cranked out release version 1.1 of Social Feed Manager.
The Twitter API is a powerful tool for archiving, but its use poses particular challenges for archivists.
Last week, Internet Archive put out a call for URL nominations for a Pulse Nightclub web collection. This blog post describes how I extracted 200,094 unique ...
We're pleased to release version 1.0 of Social Feed Manager, which includes the functionality to select, create, manage, and explore social media collections.
This week, GW Libraries' software development librarians working on Social Feed Manager participated in the Archives Unleashed 2.0 hackathon hosted at the Li...
It is heartbreaking that our first use of SFM to capture a breaking event was for the shooting at the Pulse Nightclub. My thoughts go out to the families, t...
We'e abandoning record segmentation for harvesting the Twitter Streaming API to WARC files and trying a new approach.
This is a guide for programmers and researchers who intend to use Weibo's API. Since the current official documentation hasn't been updated for a long time, ...
In her blog post, “Social Media for Good: the Series, Episode 2”, DPC’s Sara Day Thomson explains: New work also reveals the heightened importance of archive...
The latest in our social media harvesting experiments for the Social Feed Manager project involves analysis, discovery, and visualization of social media con...
The Twitter Streaming API is very powerful, allowing harvesting tweets not readily available from the other APIs.
Social Feed Manager (SFM) is a tool developed by the Scholarly Technology Group for harvesting social media to support research and build archives. As part o...
Social Feed Manager is supported by a grant from the National Historical Publications & Records Commission