SCM

SCM Repository

[tm] Diff of /trunk/tm/ChangeLog
ViewVC logotype

Diff of /trunk/tm/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 71, Sun Nov 19 17:30:26 2006 UTC trunk/tm/ChangeLog revision 799, Thu Nov 29 11:05:23 2007 UTC
# Line 1  Line 1 
1    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
2    
3            * R/textdoccol.R (TextDocCol): Better handling of empty
4            arguments.
5    
6            * NAMESPACE: Exported readDOC.
7    
8    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
9    
10            * R/stopwords.R (stopwords): Look up .dat files at every
11            call. Allows users to modify stopword .dat files interactively.
12    
13    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
14    
15            * R/termdocmatrix.R (termFreq): Correct processing of empty
16            documents.
17    
18    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
19    
20            * man/: Updated documentation.
21    
22    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
23    
24            * R/complete.R (completeStems): Completes (heuristically) word
25            stems.
26    
27            * R/termdocmatrix.R (TermDocMatrix2): New modular
28            constructor.
29    
30            * NAMESPACE: Exported termFreq.
31    
32    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
33    
34            * R/reader.R (readDOC): Added MS Word reader (using antiword).
35    
36    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
37    
38            * R/weight.R: Weighting functions for TermDocMatrix.
39    
40    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
41    
42            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
43            functions for accessing dimension, column, and row names.
44    
45            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
46    
47    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
48    
49            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
50    
51    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
52    
53            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
54    
55    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
56    
57            * R/reader.R (readPDF): Removed manual checks for pdftotext and
58            pdfinfo. The system call gives a warning anyway.
59    
60    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
61    
62            * R/textdoccol.R (asPlain): Conversion from
63            StructuredTextDocuments to PlainTextDocuments.
64    
65    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
66    
67            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
68            for accessing term-document matrices.
69    
70            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
71            are installed.
72    
73    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
74    
75            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
76            Christian Buchta.
77    
78    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
79    
80            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
81    
82    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
83    
84            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
85    
86            * R/reader.R (readPDF): Added PDF reader.
87    
88    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
89    
90            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
91    
92            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
93    
94            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
95    
96            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
97    
98    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
99    
100            * R/distmeasure.R (dissimilarity): Replaced dists call from
101            package cba by new dist call from package proxy.
102    
103    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
104    
105            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
106    
107    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
108    
109            * R/termdocmatrix.R: require() uses the quietly option to suppress
110            loading messages.
111    
112    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
113    
114            * R/dictionary.R: Added dictionary support.
115    
116    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
117    
118            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
119            documents. This simplifies some functions, e.g., asPlain.
120    
121    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
122    
123            * inst/doc/tm.Rnw: Fixed some typos in vignette.
124    
125    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
126    
127            * R/textdoccol.R (replaceWords): Added method to replace a set of
128            words by a single word. Useful for synonyms.
129    
130    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
131    
132            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
133    
134    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
135    
136            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
137            vectors. Thanks to Ariel Maguyon for his error report.
138            (removeSparseTerms): New function to remove columns from a
139            term-document matrix exceeding a sparse factor.
140    
141    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
142    
143            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
144    
145    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
146    
147            * man/sFilter.Rd: Corrected documentation on statement format (use
148            '==' instead of '=').
149    
150    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
151    
152            * R/aobjects.R (StructuredTextDocument): Inherits from
153            TextDocument.
154    
155    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
156    
157            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
158            on sparse matrices as proposed by Martin Maechler.
159    
160    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
161    
162            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
163            \pkg{filehash} version makes them deprecated.
164    
165    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
166    
167            * R/termdocmatrix.R (textvector): Stemming is now performed before
168            erasing stopwords.
169            (weightMatrix): Adapted to handle sparse matrices.
170            (TermDocMatrix): Sparse matrix is now efficiently built by
171            direct stepwise insertion of row values into it.
172    
173    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
174    
175            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
176            due to ongoing problems. For our purposes the latter is as useful
177            as the replaced package.
178    
179    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
180    
181            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
182    
183            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
184    
185    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
186    
187            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
188            languages with available stopwords.
189    
190    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
191    
192            * inst/doc/tm.Rnw: Minor corrections in the vignette.
193    
194    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
195    
196            * DESCRIPTION: Update to version 0.2, since a lot of new features
197            have been integrated.
198    
199            * inst/stopwords: Updated existing stopwords and added stopwords
200            for various other languages.
201    
202    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
203    
204            * man/: Updated documentation.
205    
206            * Work/testDb.R: Script to test database stuff.
207    
208            * R/: Fixed various database related bugs. Seems to be rather
209            useable now, i.e., consider as alpha status for now.
210    
211    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
212    
213            * R/: Fixed some bugs related to database support.
214    
215    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
216    
217            * man/: Added a lot of examples to the manuals.
218    
219    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
220    
221            * man/: Updated parts of the documentation.
222    
223            * R/textdoccol.R (asPlain): Added conversion from newsgroup
224            documents to plain text documents.
225    
226    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
227    
228            * R/textdoccol.R: Finished experimental database support. Not yet
229            intensively tested.
230    
231            * R/source.R: Now each source has a default reader.
232    
233            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
234            class anymore.
235    
236            * R/plaintextdoc.R: Custom show method for plain text documents.
237    
238            * R/aobjects.R: Added a class for structured text documents.
239    
240            * R/reader.R: Replaced remaining \code{parser} occurrences with
241            \code{reader}.
242    
243            * R/textdoccol.R (summary): Indent tags.
244    
245            * R/textdoccol.R (removePunctuation): Transform method to remove
246            punctuation marks.
247    
248    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
249    
250            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
251            using prescindMeta().
252    
253    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
254    
255            * R/textdoccol.R: Improved database support.
256    
257    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
258    
259            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
260    
261            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
262            language code.
263    
264            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
265            into parserControl argument.
266    
267            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
268    
269    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
270    
271            * Work/tmDataSetup.R: The datasets acq and crude can now be
272            created on the fly.
273    
274            * R/stopwords.R: Introduced a function returning the stopwords for
275            a given language (English, German and French at the moment)
276    
277            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
278            otherwise falls back to Snowball package.
279    
280    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
281    
282            * man/dissimilarity-methods.Rd: Make clear that any method offered
283            by "dists" from package "cba" can be used.
284    
285    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
286    
287            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
288            to Kurt's latex suggestion. Removed points and underscores in
289            variable names for consistent naming.
290    
291            * DESCRIPTION: Update to version 0.1-2.
292    
293            * man/TextRepository.Rd: Fixed bug in documentation.
294    
295    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
296    
297            * DESCRIPTION: Update to version 0.1-1.
298    
299    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
300    
301            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
302            wordStem.
303    
304    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
305    
306            * R/: Changes due to Kurt's review.
307    
308    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
309    
310            * R/: Implemented improvements based upon comments by David
311            Meyer.
312    
313    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
314    
315            * inst/doc/: Rewrote vignette.
316    
317            * man/: Improved documentation.
318    
319    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
320    
321            * man/: Updated documentation.
322    
323            * DESCRIPTION: Changed package name to "tm". Updated version to
324            0.1 for first CRAN release.
325    
326            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
327            list archive example.
328    
329            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
330            archive example.
331    
332            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
333            from (several mails per box) mbox format to (single mail per file)
334            eml format.
335    
336    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
337    
338            * data/crude.rda: Rebuilt.
339    
340            * data/acq.rda: Rebuilt.
341    
342            * R/reader.R: Factored out reader and parser methods from
343            textdoccol.R.
344    
345            * R/source.R: Factored out Source methods from aobjects.R and
346            textdoccol.R.
347            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
348            feeds.
349    
350            * R/textdoccol.R (DirSource): Added support for recursive
351            traversal of directories.
352    
353    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
354    
355            * R/textdoccol.R ([[): Loads the document corpus automatically
356            into memory upon access.
357            (tm_transform, tm_filter): Removed several checks whether the
358            document is already loaded ([[ ensures this now).
359            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
360            mailing list archive.
361    
362    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
363    
364            * R/aobjects.R (TextDocument): Is now a virtual class.
365            (Source): Is now a virtual class.
366    
367    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
368    
369            * R/textdoccol.R (c): Support for an arbitrary number of document
370            collections.
371    
372    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
373    
374            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
375            append_meta and remove_meta.
376    
377            * R/textdoccol.R: Removed modify_metadata method.
378    
379            * R/textrepo.R: Removed modify_metadata method.
380    
381            * R/textdoccol.R (remove_meta): Supports removal of document
382            collection metadata and document (= in data frame) metadata.
383    
384    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
385    
386            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
387    
388            * data/crude.rda: Rebuilt.
389    
390            * data/acq.rda: Rebuilt.
391    
392            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
393    
394            * R/textdoccol.R ([): Bug fix for subsetting a document
395            collection's data frame.
396    
397    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
398    
399            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
400            to s_filter.
401    
402            * R/textdoccol.R: Local text documents' metadata can now be copied
403            to a document collection's data frame with prescind_meta.
404    
405    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
406    
407            * R/: Text documents' slot metadata is now accessible in s_filter.
408    
409            * R/: Rewrote s_filter function (has still some restrictions).
410    
411    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
412    
413            * R/: Various fixes in handling metadata.
414    
415            * R/: Added update mechanism for text document collections.
416    
417  2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
418    
419          * R/: Merging of document collections now creates a binary tree          * R/: Merging of document collections now creates a binary tree

Legend:
Removed from v.71  
changed lines
  Added in v.799

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge