Regex Is Capturing The Whole String
Solution 1:
Because you accepted my (wrong) answer in the other thread, I feel myself kind of obliged to post a proper solution. This is not going to be quick and short, but hopefully helps a bit.
The following is how I would write a regexp-based parser for a c-alike language if I had to.
<script>/*
Let's start with this simple utility function. It's a
kind of stubborn version of String.replace() - it
checks the string over and over again, until nothing
more can be replaced
*/functionreplaceAll(str, regexp, repl) {
str = str.toString();
while(str.match(regexp))
str = str.replace(regexp, repl);
return str;
}
/*
Next, we need a function that removes specific
constructs from the text and replaces them with
special "markers", which are "invisible" for further
processing. The matches are collected in a buffer so
that they can be restored later.
*/functionisolate(type, str, regexp, buf) {
returnreplaceAll(str, regexp, function($0) {
buf.push($0);
return"<<" + type + (buf.length - 1) + ">>";
});
}
/*
The following restores "isolated" strings from the
buffer:
*/functionrestore(str, buf) {
returnreplaceAll(str, /<<[a-z]+(\d+)>>/g, function($0, $1) {
return buf[parseInt($1)];
});
}
/*
Write down the grammar. Javascript regexps are
notoriously hard to read (there is no "comment"
option like in perl), therefore let's use more
readable format with spacing and substitution
variables. Note that "$string" and "$block" rules are
actually "isolate()" markers.
*/var grammar = {
$nothing: "",
$space: "\\s",
$access: "public $space+ | private $space+ | $nothing",
$ident: "[a-z_]\\w*",
$args: "[^()]*",
$string: "<<string [0-9]+>>",
$block: "<<block [0-9]+>>",
$fun: "($access) function $space* ($ident) $space* \\( ($args) \\) $space* ($block)"
}
/*
This compiles the grammar to pure regexps - one for
each grammar rule:
*/functioncompile(grammar) {
var re = {};
for(var p in grammar)
re[p] = newRegExp(
replaceAll(grammar[p], /\$\w+/g,
function($0) { return grammar[$0] }).
replace(/\s+/g, ""),
"gi");
return re;
}
/*
Let's put everything together
*/functionfindFunctions(code, callback) {
var buf = [];
// isolate strings
code = isolate("string", code, /"(\\.|[^\"])*"/g, buf);
// isolate blocks in curly brackets {...}
code = isolate("block", code, /{[^{}]*}/g, buf);
// compile our grammarvar re = compile(grammar);
// and perform an action for each function we can find
code.replace(re.$fun, function() {
var p = [];
for(var i = 1; i < arguments.length; i++)
p.push(restore(arguments[i], buf));
return callback.apply(this, p)
});
}
</script>
Now we're ready to test. Our parser must be able to deal with escaped strings and arbitrary nested blocks.
<code>
publicfunctionblah(arg1, arg2) {
if("some string" == "public function") {
callAnother("{hello}")
while(something) {
alert("escaped \" string");
}
}
}
functionyetAnother() { alert("blah") }
</code>
<script>
window.onload = function() {
var code = document.getElementsByTagName("code")[0].innerHTML;
findFunctions(code, function(access, name, args, body) {
document.write(
"<br>" +
"<br> access= " + access +
"<br> name= " + name +
"<br> args= " + args +
"<br> body= " + body
)
});
}
</script>
Solution 2:
By default, the *
operator is greedy, consuming as many characters as possible. Try *?
, the non-greedy equivalent.
/((?:(?:public|private)\s+)?)function\s+([a-zA-Z_$][\w$]*)\s*\(([\w$, ]*)\)\s*{(.*?)}/
\w
matches words and is equivalent to [a-zA-Z0-9_]
but can be used in character classes. Note that this won't match functions with blocks in them, such as:
function foo() {
for (p inthis) {
...
}
}
That's tricky to impossible to do with regexps unless they support recursion (which JS's don't), which is why you need a proper parser.
Solution 3:
Try changing
(.*)
to
(.*?)
Solution 4:
Change this last part of your regex:
{(.*)}
To this:
{(.*?)}
This makes it "non-greedy", so that it doesn't capture to the last }
in the input.
Note that this will break if any of the function code ever includes a }
character, but then you're dealing with nesting, which is never something that regular expressions do well.
Post a Comment for "Regex Is Capturing The Whole String"